-- Logs begin at Wed 2022-08-31 14:13:47 UTC, end at Wed 2022-08-31 15:24:59 UTC. -- Aug 31 14:52:13.678786 dv-osbrick-853789-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 14:52:13.689543 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 14:52:13.691634 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 14:52:13 2022] *** Aug 31 14:52:13.691634 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 14:52:13.691634 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 14:52:13.691634 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: nodename: dv-osbrick-853789-3-ceph Aug 31 14:52:13.691634 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: machine: x86_64 Aug 31 14:52:13.691634 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: clock source: unix Aug 31 14:52:13.691634 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: pcre jit disabled Aug 31 14:52:13.691634 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: detected number of CPU cores: 4 Aug 31 14:52:13.691634 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: current working directory: / Aug 31 14:52:13.691634 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: detected binary path: /usr/bin/uwsgi-core Aug 31 14:52:13.692326 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: your processes number limit is 47680 Aug 31 14:52:13.692326 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: your memory page size is 4096 bytes Aug 31 14:52:13.692326 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: detected max file descriptor number: 2048 Aug 31 14:52:13.692326 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: lock engine: pthread robust mutexes Aug 31 14:52:13.692326 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: thunder lock: enabled Aug 31 14:52:13.692326 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 14:52:13.692326 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 14:52:13.738145 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: Python main interpreter initialized at 0x55e5bdd3b9c0 Aug 31 14:52:13.738145 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: python threads support enabled Aug 31 14:52:13.738145 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: your server socket listen backlog is limited to 100 connections Aug 31 14:52:13.738145 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: your mercy for graceful operations on workers is 90 seconds Aug 31 14:52:13.738507 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 14:52:13.738586 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: *** Operational MODE: preforking *** Aug 31 14:52:13.738852 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: *** uWSGI is running in multiple interpreter mode *** Aug 31 14:52:13.738852 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: spawned uWSGI master process (pid: 88455) Aug 31 14:52:13.739055 dv-osbrick-853789-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 31 14:52:13.740033 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: spawned uWSGI worker 1 (pid: 88467, cores: 1) Aug 31 14:52:13.740033 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: spawned uWSGI worker 2 (pid: 88468, cores: 1) Aug 31 14:52:13.740185 dv-osbrick-853789-3-ceph devstack@keystone.service[88455]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 14:52:18.405680 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 14:52:18.405680 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: from cryptography.utils import int_from_bytes Aug 31 14:52:18.406475 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 14:52:18.406475 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: from cryptography.utils import int_from_bytes Aug 31 14:52:18.407004 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 14:52:18.407004 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: from cryptography.utils import int_from_bytes Aug 31 14:52:18.407457 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 14:52:18.407457 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: from cryptography.utils import int_from_bytes Aug 31 14:52:18.456620 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 14:52:18.456819 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 14:52:18.456922 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 14:52:18.457014 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 14:52:18.457093 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] command line args: [] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 14:52:18.457170 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] command line args: [] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 14:52:18.457273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 14:52:18.457436 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 14:52:18.457522 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ================================================================================ {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 14:52:18.457594 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ================================================================================ {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 14:52:18.457697 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] admin_token = **** {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.457849 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] admin_token = **** {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.457934 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] config_dir = [] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.458095 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] config_dir = [] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.458181 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.458280 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.458377 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] config_source = [] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.458488 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] debug = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.458623 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] config_source = [] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.458714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] debug = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.458797 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.458979 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.459075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.459150 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.459209 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.459271 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.459518 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.459603 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.459744 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.459836 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.459903 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] list_limit = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.459967 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] list_limit = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.460112 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] log_config_append = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.460191 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] log_config_append = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.460256 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.460322 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.460509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] log_dir = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.460601 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] log_dir = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.460601 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] log_file = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.460712 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] log_file = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.460808 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.460934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.461052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.461138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.461296 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.461385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.461538 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.461635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.461704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.461762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.461870 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.462049 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.462143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.462223 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.462395 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.462474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.462595 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.463176 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.463335 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.463415 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.463568 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.463702 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.463828 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.463918 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.464036 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.464121 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.464277 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.464361 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.464547 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.464637 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.465030 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.465108 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.465240 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] publish_errors = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.465318 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] publish_errors = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.465436 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.465509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.465630 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.465762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.465842 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.465960 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.466041 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.466138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.466251 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.466366 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.466509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] standard_threads = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.466588 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] standard_threads = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.466738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.466815 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.466977 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.467062 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.467179 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.467963 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.468082 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] use_journal = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.468197 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] use_journal = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.468292 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] use_json = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.468367 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] use_json = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.468448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] use_stderr = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.468520 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] use_stderr = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.468590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] use_syslog = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.468658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] use_syslog = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.468736 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.468808 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 14:52:18.468877 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.468952 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469019 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469246 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469319 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469394 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469463 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469532 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469605 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469686 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469756 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469900 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.469970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.470038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.470115 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.470186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.470334 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.470432 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.470586 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.470678 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.470816 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.470893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.471060 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.471136 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.471294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.471380 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.471536 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.471619 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.471780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.471864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.472013 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.472098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.472263 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.472340 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.472513 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.472590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.472753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.472841 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.472985 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.473061 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.473232 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.473314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.473492 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.473576 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.473741 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.473817 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.473986 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.474064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.474215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.474407 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.474492 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.474564 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.474687 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.474773 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.474921 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.475007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.475165 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.475248 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.475406 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.475484 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.475634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.475720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.475860 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.475943 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.476103 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.476178 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.476347 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.476433 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.476580 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.476662 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.476823 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.476900 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.477050 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.477134 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.477284 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.477361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.477517 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.477593 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.477744 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.477828 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.477972 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.478047 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.478198 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.478420 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.479030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.479102 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.479229 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.479308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.479480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.479588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.479704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.479789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.479937 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.480021 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.480164 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.480241 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.480399 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.480490 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.480629 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.480715 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.480873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.480951 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.481100 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.481176 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.481333 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.481412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.481565 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.481642 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.481798 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.481886 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.482035 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.482113 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.482261 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.482371 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.482512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.482609 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.482759 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.482838 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.482991 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.483070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.483226 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.483312 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.483451 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.483529 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.483704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.483792 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.483935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.484013 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.484161 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.484241 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.484659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.484743 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.484891 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.484969 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.485165 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.485243 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.485399 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.485476 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.485643 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.485720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.485884 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.485963 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.486116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.486192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.486371 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.486467 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.486620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.486700 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.486840 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.486919 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.487075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.487159 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.487311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.487392 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.487551 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.487628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.487784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.487867 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.488134 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.488224 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.488374 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.488452 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.488608 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.488685 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.488845 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.488936 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.489079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.489157 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.489313 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.489391 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.489570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.489659 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.489809 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.489888 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.490055 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.490132 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.490317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.490413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.490550 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.490630 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.490789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.490873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.491024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.491110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.491259 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.491335 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.491493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.491570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.491722 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.491807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.491954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.492032 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.492182 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.492259 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.492414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.492499 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.492642 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.492719 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.492877 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.492954 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.493107 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.493192 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.493350 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.493428 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.493585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.493663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.493838 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.493924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.494125 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.494254 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.494376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.494485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.494606 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] auth.external = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.494697 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] auth.external = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.494837 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.494926 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.495129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.495235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.495360 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.495469 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.495588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] auth.password = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.495702 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] auth.password = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.495816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] auth.token = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.495932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] auth.token = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.496053 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.496172 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.496288 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.496407 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.496533 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.496653 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.496763 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.496883 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.497014 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.497130 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.497247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.497375 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.497476 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.497606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.497694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] credential.caching = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.497839 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] credential.caching = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.497927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.498085 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.498175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.498354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.498452 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.498604 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.498685 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.498864 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.498955 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.499110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.499197 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.499345 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.499421 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.499589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.499667 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.499822 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.499908 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.500061 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.500139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.500317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.500395 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.500569 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.500719 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.500830 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.500915 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.501069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.501147 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.501320 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.501406 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.501551 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] federation.caching = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.501629 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.501785 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.501864 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] federation.caching = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.502018 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.502104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.502260 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.502381 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.502513 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.502604 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.502746 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.502836 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.502981 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.503061 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.503214 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.503292 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.503454 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.503543 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.503687 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.503765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.503927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.504011 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.504160 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.504253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.504392 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.caching = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.504471 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.504625 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.caching = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.504703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.504868 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.504955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.505103 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.505183 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.505335 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.505414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.505566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.505652 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.505796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.505875 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.506028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.506106 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.506278 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.506430 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.506538 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.506675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.506756 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.506829 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.506987 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.507077 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.507223 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.507302 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.507454 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.507533 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.507698 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.507784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.507942 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.508021 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.508188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.508266 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.508431 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.508511 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.508673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.508755 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.508923 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.509002 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.509161 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.509241 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.509391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.509470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.509653 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.509730 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.509947 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.510028 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.510209 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.510319 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.510474 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.510554 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.510713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.510794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.510952 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.511038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.511179 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.511258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.511418 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.511536 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.511662 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.511747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.511894 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.511973 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.512127 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.512212 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.512368 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.512447 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.512597 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.512675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.512826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.512905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.513050 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.513128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.513277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.513354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.513509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.513590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.513742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.513820 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.513975 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.514060 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.514209 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.514307 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.514467 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.514546 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.514715 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.514793 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.514944 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.515026 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.515171 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.515257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.515399 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.515478 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.515647 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.515728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.515877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.515955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.516109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.516188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.516339 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.516424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.516565 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.516643 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.516790 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.516868 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.517053 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.517184 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.517273 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.517348 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.517496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.517576 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.517739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.517819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.517980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.518058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.518213 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.518359 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.518454 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.518536 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.518682 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.518762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.518911 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.518989 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.519141 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.519219 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.519367 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.519445 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.519592 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.519678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.519835 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.519915 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.520076 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.520153 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.520320 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.520408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.520563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.520641 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.520789 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.520867 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.521019 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.521105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.521253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.521332 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.521488 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.521567 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.521720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.521806 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.521953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.522030 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.522187 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.522265 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.522455 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.522548 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.522692 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.522771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.522927 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.523005 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.523164 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.523316 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.523393 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.523464 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.523623 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.523702 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.523853 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.523939 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.524083 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.524161 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.524320 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.524399 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.524556 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.524642 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.524786 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.524864 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.525014 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.525092 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.525812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] resource.caching = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.525912 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.526064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.526144 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] resource.caching = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.526349 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.526513 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.526593 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.526674 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.526822 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.526904 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.527830 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.527897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.527897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528018 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528137 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528137 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528296 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528360 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528420 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528478 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] role.caching = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528535 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] role.caching = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528592 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] role.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528648 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528712 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] role.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528875 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.528957 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.529109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.529185 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.529349 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.529433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.529598 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.529679 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.529868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.529945 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.530243 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.530472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.530542 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.530602 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.530660 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.530718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.530776 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.530843 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.531675 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.531753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.531813 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.531871 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.531929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.531996 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.532057 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.532116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.532116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.532220 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533036 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533118 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533180 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533246 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533306 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533436 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533497 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533555 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533613 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533671 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533729 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533795 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.533856 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.534487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.534574 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.534636 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.534695 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.534767 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.534830 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.534895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.534954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.535012 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.535071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.535137 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.535198 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.535714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.535796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.535859 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.535917 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.535984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.536046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.536105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.536163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.536543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.536869 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.536953 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] token.caching = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.537016 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.537075 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.537816 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] token.caching = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.537816 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.538750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.538750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.538926 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.538926 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539035 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539094 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539223 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539432 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539491 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539549 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539735 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539849 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539914 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.539974 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540032 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540090 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540146 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540209 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540275 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540414 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540481 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540553 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540621 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540681 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.540796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.connection = **** {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.541439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.541514 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.connection = **** {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.542388 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.542505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.542576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.542638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.542708 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.542771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.542831 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.542890 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.542948 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.543007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.543140 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.543204 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.543263 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.543358 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.543458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.543608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.543689 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.543833 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.543925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.544069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.544161 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.544314 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.544412 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.544550 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.544639 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.544799 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.544879 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.545036 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.545131 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.545281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.545362 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.545511 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.545590 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.545693 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 14:52:18.545782 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.545971 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 14:52:18.546140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 14:52:18.575040 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.575270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.575496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.575978 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.576209 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.576430 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.584276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.584990 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.615424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.615648 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.615984 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.616218 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.668661 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.669061 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.717339 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.717572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.718683 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.718918 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.784043 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.784185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.784328 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.784417 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.784560 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.784663 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.784784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.784867 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.785000 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.785083 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.785215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.785429 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.808193 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.808423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.808644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.808730 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.808867 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.808951 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.809084 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.809166 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.809295 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.809387 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.809506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.809591 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.809733 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.809947 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.820552 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.820889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.833658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.833906 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.834002 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.834108 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.834209 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.834346 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.834434 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.834564 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.834644 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.835201 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.835330 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.835436 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.835540 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88468) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.835651 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88467) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 14:52:18.865728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.865940 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 14:52:18.866142 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.866283 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.866545 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 14:52:18.866660 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 14:52:18.866775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.867010 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.867095 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.867275 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.867355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 14:52:18.867532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.867749 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.868077 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.868401 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.868719 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.877163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.877441 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.877711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.877990 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.878685 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.879026 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.879416 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.879786 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.885635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.887611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.888555 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.888839 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.889124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.889406 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.889686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.889943 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.890209 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.890506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.890782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.891053 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.891234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.891315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.891666 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.892055 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.892401 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.892749 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.893071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.893414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.893748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.894081 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.894455 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.894786 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.916445 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.917898 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.918179 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.920190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.921665 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.922021 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.922886 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.923175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.923454 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.926989 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.927335 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.927681 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.929849 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.930139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.934403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.934497 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.936358 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.936484 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.936566 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.936566 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.936566 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.936566 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.936566 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.936566 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.938933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.939227 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.939522 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.939818 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.940095 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.940367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.940646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.940921 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.952489 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.952767 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.956681 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.957305 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.957584 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.959886 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.960192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.961469 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.965068 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.965463 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.965757 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.968244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.970030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.971461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.971797 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.972089 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.972371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.972658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.972948 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.973201 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.976452 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.976756 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.977053 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.977341 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.977626 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.977911 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.989416 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.989726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.989999 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.990264 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.994041 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:18.994426 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.994680 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.994990 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.997158 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:18.998690 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.000212 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.000488 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.001829 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.003126 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.003369 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.003468 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.003691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.003974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.004371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.004887 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.005164 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.007835 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.008124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.008413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.008704 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.009104 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.016202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.016485 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.016766 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.017049 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.017459 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.017740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.018036 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.022190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.022532 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.022820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.023097 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.023488 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.023784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.024071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.034152 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.037032 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.039900 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.040374 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.041580 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.043077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.043295 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.043398 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.044618 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.046201 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.047645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.049101 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.049392 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.050692 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.051234 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.052678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.055550 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.055944 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.056229 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.056995 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.057306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.058792 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.061802 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.062104 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.062418 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.062699 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.064425 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.064719 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.065001 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.070706 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.071004 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.071285 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.071872 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88468) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.072947 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.072947 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.073221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.073489 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.073765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.074037 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.074390 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.074686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.074954 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.075232 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.075489 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.075751 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.076015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88468) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.078821 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88467) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 14:52:19.079105 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.079385 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.079670 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.079974 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.080393 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.080504 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.080769 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.081060 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.081326 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.081599 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.081859 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.082120 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.082406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88467) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 14:52:19.110007 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e5bdd3b9c0 pid: 88468 (default app) Aug 31 14:52:19.113268 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb8337-6508-4efb-b5d5-55bded2f9797 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:19.113555 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb8337-6508-4efb-b5d5-55bded2f9797 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:19.113836 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb8337-6508-4efb-b5d5-55bded2f9797 None None] PATH_INFO: `/v3` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:19.116490 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e5bdd3b9c0 pid: 88467 (default app) Aug 31 14:52:19.118916 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Wed Aug 31 14:52:19 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:27.069865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e36b2d-763d-4005-bf6b-ccc273d003d2 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:27.070394 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e36b2d-763d-4005-bf6b-ccc273d003d2 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:27.070474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e36b2d-763d-4005-bf6b-ccc273d003d2 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:27.075151 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:52:27.080460 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419006-e282-4f7e-95cf-947400180482 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:27.080865 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419006-e282-4f7e-95cf-947400180482 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:27.081009 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419006-e282-4f7e-95cf-947400180482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:27.157459 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: INFO dbcounter [None req-15419006-e282-4f7e-95cf-947400180482 None None] Registered counter for database keystone Aug 31 14:52:27.176711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG oslo_db.sqlalchemy.engines [None req-15419006-e282-4f7e-95cf-947400180482 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 14:52:27.183587 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writer thread running {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 14:52:27.360246 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG passlib.handlers.bcrypt [None req-15419006-e282-4f7e-95cf-947400180482 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88468) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 14:52:27.360649 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG passlib.handlers.bcrypt [None req-15419006-e282-4f7e-95cf-947400180482 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88468) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 14:52:27.418528 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-15419006-e282-4f7e-95cf-947400180482 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:27.420038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-15419006-e282-4f7e-95cf-947400180482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:27.549295 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 31 14:52:28.097468 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e36b2d-763d-4005-bf6b-ccc273d003d2 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:28.173276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: INFO dbcounter [None req-c4e36b2d-763d-4005-bf6b-ccc273d003d2 None None] Registered counter for database keystone Aug 31 14:52:28.194894 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG oslo_db.sqlalchemy.engines [None req-c4e36b2d-763d-4005-bf6b-ccc273d003d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 14:52:28.201474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writer thread running {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 14:52:28.317921 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e36b2d-763d-4005-bf6b-ccc273d003d2 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:28.322378 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1caa82-5346-405e-9022-8fc1b31b506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:28.322992 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1caa82-5346-405e-9022-8fc1b31b506e admin admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:28.323273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1caa82-5346-405e-9022-8fc1b31b506e admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:28.323550 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1caa82-5346-405e-9022-8fc1b31b506e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:28.331556 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1caa82-5346-405e-9022-8fc1b31b506e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:28.383493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba1caa82-5346-405e-9022-8fc1b31b506e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 14:52:28.383836 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1caa82-5346-405e-9022-8fc1b31b506e admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:28.393918 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1324 bytes} [Wed Aug 31 14:52:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 14:52:28.401141 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15419006-e282-4f7e-95cf-947400180482 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:28.416427 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15419006-e282-4f7e-95cf-947400180482 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:28.420958 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d2109-4e59-40c7-ac5e-481d79eb591a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:28.422046 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d2109-4e59-40c7-ac5e-481d79eb591a admin admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:28.422365 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d2109-4e59-40c7-ac5e-481d79eb591a admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:28.422643 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d2109-4e59-40c7-ac5e-481d79eb591a admin admin] PATH_INFO: `/v3/projects/b905fa215ef84f989a1edb29db9488aa` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:28.424127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d2109-4e59-40c7-ac5e-481d79eb591a admin admin] RBAC: Authorizing `identity:get_project(project_id=b905fa215ef84f989a1edb29db9488aa)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:28.474970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8f4d2109-4e59-40c7-ac5e-481d79eb591a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 14:52:28.475314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d2109-4e59-40c7-ac5e-481d79eb591a admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:28.480841 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 3/5] 10.222.0.52 () {56 vars in 1207 bytes} [Wed Aug 31 14:52:28 2022] GET /identity/v3/projects/b905fa215ef84f989a1edb29db9488aa => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:30.647934 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5c288-fd4b-4d91-9740-39d5aa7e8193 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:30.648523 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5c288-fd4b-4d91-9740-39d5aa7e8193 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:30.648523 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5c288-fd4b-4d91-9740-39d5aa7e8193 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:30.653405 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 3/6] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:30.658848 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b51f5-0e48-4ca1-b274-fcf2aae4061a None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:30.659282 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b51f5-0e48-4ca1-b274-fcf2aae4061a None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:30.659410 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b51f5-0e48-4ca1-b274-fcf2aae4061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:30.680011 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-1b0b51f5-0e48-4ca1-b274-fcf2aae4061a None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:30.681565 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-1b0b51f5-0e48-4ca1-b274-fcf2aae4061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:30.689596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 14:52:31.014061 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5c288-fd4b-4d91-9740-39d5aa7e8193 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:31.027350 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5c288-fd4b-4d91-9740-39d5aa7e8193 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:31.031905 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68059326-b06a-41c1-b5b8-2abede83373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:31.032505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68059326-b06a-41c1-b5b8-2abede83373d admin admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:31.032787 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68059326-b06a-41c1-b5b8-2abede83373d admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:31.033063 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68059326-b06a-41c1-b5b8-2abede83373d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:31.040955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68059326-b06a-41c1-b5b8-2abede83373d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:31.042765 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68059326-b06a-41c1-b5b8-2abede83373d admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:31.051488 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1324 bytes} [Wed Aug 31 14:52:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 14:52:31.056793 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b51f5-0e48-4ca1-b274-fcf2aae4061a None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:31.065857 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b51f5-0e48-4ca1-b274-fcf2aae4061a None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:31.070183 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dc80d-fddb-4b65-9c32-66dd611ce88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:31.070830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dc80d-fddb-4b65-9c32-66dd611ce88f admin admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:31.071110 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dc80d-fddb-4b65-9c32-66dd611ce88f admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:31.071896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dc80d-fddb-4b65-9c32-66dd611ce88f admin admin] PATH_INFO: `/v3/users/e7a12e84a7cb44eba823234391e6a002` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:31.073264 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dc80d-fddb-4b65-9c32-66dd611ce88f admin admin] RBAC: Authorizing `identity:get_user(user_id=e7a12e84a7cb44eba823234391e6a002)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:31.075121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dc80d-fddb-4b65-9c32-66dd611ce88f admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:31.076624 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 5/9] 10.222.0.52 () {56 vars in 1198 bytes} [Wed Aug 31 14:52:31 2022] GET /identity/v3/users/e7a12e84a7cb44eba823234391e6a002 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:33.297540 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bc100-d4fb-4d83-ba58-37b880e1805c None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:33.298073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bc100-d4fb-4d83-ba58-37b880e1805c None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:33.298073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bc100-d4fb-4d83-ba58-37b880e1805c None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:33.299619 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:33.304424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff988408-648a-4831-bfe7-aba062c5e11a None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:33.304814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff988408-648a-4831-bfe7-aba062c5e11a None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:33.305084 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff988408-648a-4831-bfe7-aba062c5e11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:33.324814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-ff988408-648a-4831-bfe7-aba062c5e11a None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:33.326003 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-ff988408-648a-4831-bfe7-aba062c5e11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:33.377043 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3a7c8-7fc3-4aba-9348-89e82836a8ae None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:33.377324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3a7c8-7fc3-4aba-9348-89e82836a8ae None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:33.377600 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3a7c8-7fc3-4aba-9348-89e82836a8ae None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:33.378990 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 6/11] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:52:33.384865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea3d10-2fad-4f95-952e-614ede281ca0 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:33.385151 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea3d10-2fad-4f95-952e-614ede281ca0 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:33.385395 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea3d10-2fad-4f95-952e-614ede281ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:33.429542 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG passlib.handlers.bcrypt [None req-9dea3d10-2fad-4f95-952e-614ede281ca0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88467) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 14:52:33.429922 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG passlib.handlers.bcrypt [None req-9dea3d10-2fad-4f95-952e-614ede281ca0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88467) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 14:52:33.480070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-9dea3d10-2fad-4f95-952e-614ede281ca0 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:33.481670 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-9dea3d10-2fad-4f95-952e-614ede281ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:33.517267 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:33.581159 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:52:33.848704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff988408-648a-4831-bfe7-aba062c5e11a None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:33.874171 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:33.907449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea3d10-2fad-4f95-952e-614ede281ca0 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:33.955338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff988408-648a-4831-bfe7-aba062c5e11a None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:33.989009 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a49906-14d2-40ca-8149-b8fb815a9ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:33.989654 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a49906-14d2-40ca-8149-b8fb815a9ada None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:33.989937 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a49906-14d2-40ca-8149-b8fb815a9ada None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:33.990211 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a49906-14d2-40ca-8149-b8fb815a9ada None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:34.002311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a49906-14d2-40ca-8149-b8fb815a9ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:52:34.011920 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea3d10-2fad-4f95-952e-614ede281ca0 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-a5a49906-14d2-40ca-8149-b8fb815a9ada None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:52:34.012064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:34.013115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:52:34.014099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:52:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:52:34.015727 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:34.018880 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a49906-14d2-40ca-8149-b8fb815a9ada None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:34.052562 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0445ac-983a-4080-8f83-85be005e1974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:34.053839 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0445ac-983a-4080-8f83-85be005e1974 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:34.054416 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0445ac-983a-4080-8f83-85be005e1974 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:34.054689 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0445ac-983a-4080-8f83-85be005e1974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:34.102253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:34.121337 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a49906-14d2-40ca-8149-b8fb815a9ada None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:34.124067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0445ac-983a-4080-8f83-85be005e1974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:34.125588 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0445ac-983a-4080-8f83-85be005e1974 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:34.158824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317235ac-96a1-4df8-a326-c66c6f4ab896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:34.159434 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317235ac-96a1-4df8-a326-c66c6f4ab896 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:34.159713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317235ac-96a1-4df8-a326-c66c6f4ab896 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:34.159982 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317235ac-96a1-4df8-a326-c66c6f4ab896 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:34.160634 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317235ac-96a1-4df8-a326-c66c6f4ab896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:34.160928 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317235ac-96a1-4df8-a326-c66c6f4ab896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:34.162334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317235ac-96a1-4df8-a326-c66c6f4ab896 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:34.174404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 8/15] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:52:34.180347 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317235ac-96a1-4df8-a326-c66c6f4ab896 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:34.224955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:52:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 14:52:34.230565 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0445ac-983a-4080-8f83-85be005e1974 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:34.233723 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:34.282513 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317235ac-96a1-4df8-a326-c66c6f4ab896 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:34.317556 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703941e-48da-4969-8ce9-6131fbb97b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:34.318207 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703941e-48da-4969-8ce9-6131fbb97b51 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:34.318484 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703941e-48da-4969-8ce9-6131fbb97b51 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:34.318757 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703941e-48da-4969-8ce9-6131fbb97b51 None admin] PATH_INFO: `/v3/users/e7a12e84a7cb44eba823234391e6a002` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:34.319905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703941e-48da-4969-8ce9-6131fbb97b51 None admin] RBAC: Authorizing `identity:get_user(user_id=e7a12e84a7cb44eba823234391e6a002)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:34.321913 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703941e-48da-4969-8ce9-6131fbb97b51 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:34.324063 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 9/17] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:52:34 2022] GET /identity/v3/users/e7a12e84a7cb44eba823234391e6a002 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:34.329268 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703941e-48da-4969-8ce9-6131fbb97b51 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:34.330387 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0445ac-983a-4080-8f83-85be005e1974 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:34.345720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:34.367639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2d73e-f38d-4f80-b018-8450ed8dca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:34.368584 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2d73e-f38d-4f80-b018-8450ed8dca39 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:34.369040 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2d73e-f38d-4f80-b018-8450ed8dca39 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:34.369321 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2d73e-f38d-4f80-b018-8450ed8dca39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:34.436564 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703941e-48da-4969-8ce9-6131fbb97b51 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:34.473620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb724f46-e8e7-495d-a334-6c8cf23185b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:34.474257 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb724f46-e8e7-495d-a334-6c8cf23185b1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:34.474567 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb724f46-e8e7-495d-a334-6c8cf23185b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:34.474841 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb724f46-e8e7-495d-a334-6c8cf23185b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:34.475982 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb724f46-e8e7-495d-a334-6c8cf23185b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:34.478124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb724f46-e8e7-495d-a334-6c8cf23185b1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:34.479883 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 10/18] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:52:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:52:34.486054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb724f46-e8e7-495d-a334-6c8cf23185b1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:34.496203 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2d73e-f38d-4f80-b018-8450ed8dca39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:34.497659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2d73e-f38d-4f80-b018-8450ed8dca39 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-4ca2d73e-f38d-4f80-b018-8450ed8dca39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:52:34.518080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:34.519073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:52:34.519881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:52:34.519881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:52:34.519881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:52:34.519881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 9/19] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:52:34.525663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2d73e-f38d-4f80-b018-8450ed8dca39 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:34.570469 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:34.582927 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:34.591011 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb724f46-e8e7-495d-a334-6c8cf23185b1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:34.625543 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2d73e-f38d-4f80-b018-8450ed8dca39 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:34.625726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be08c0-a24d-4546-baad-24fbb3086a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:34.626090 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be08c0-a24d-4546-baad-24fbb3086a8a None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:34.626403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be08c0-a24d-4546-baad-24fbb3086a8a None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:34.626680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be08c0-a24d-4546-baad-24fbb3086a8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:34.627403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be08c0-a24d-4546-baad-24fbb3086a8a None admin] RBAC: Adding query filter params (role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4, scope.domain.id=default, user.id=e7a12e84a7cb44eba823234391e6a002) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:34.627710 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be08c0-a24d-4546-baad-24fbb3086a8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:34.629167 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be08c0-a24d-4546-baad-24fbb3086a8a None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:34.636874 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 11/20] 10.222.0.52 () {56 vars in 1322 bytes} [Wed Aug 31 14:52:34 2022] GET /identity/v3/role_assignments?user.id=e7a12e84a7cb44eba823234391e6a002&scope.domain.id=default&role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:52:34.662907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf228ef-9e69-4a80-bcd1-14f77d74ffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:34.663544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf228ef-9e69-4a80-bcd1-14f77d74ffa0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:34.663825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf228ef-9e69-4a80-bcd1-14f77d74ffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:34.664102 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf228ef-9e69-4a80-bcd1-14f77d74ffa0 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:34.664772 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf228ef-9e69-4a80-bcd1-14f77d74ffa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:34.665607 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf228ef-9e69-4a80-bcd1-14f77d74ffa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:34.667177 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf228ef-9e69-4a80-bcd1-14f77d74ffa0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:34.687356 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 10/21] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:52:37.126535 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e695f-1699-4e15-964f-6572cd4ba671 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:37.127547 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e695f-1699-4e15-964f-6572cd4ba671 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:37.128058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e695f-1699-4e15-964f-6572cd4ba671 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:37.129598 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 12/22] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:37.147018 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ff2ba-b633-4e98-9c12-66093d32b927 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:37.147529 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ff2ba-b633-4e98-9c12-66093d32b927 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:37.147608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ff2ba-b633-4e98-9c12-66093d32b927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:37.171409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-bf1ff2ba-b633-4e98-9c12-66093d32b927 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:37.172634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-bf1ff2ba-b633-4e98-9c12-66093d32b927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:37.275001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 11/23] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:37.436852 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404b1e3-efa5-46aa-a355-242b1962d503 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:37.437221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404b1e3-efa5-46aa-a355-242b1962d503 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:37.437420 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404b1e3-efa5-46aa-a355-242b1962d503 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:37.438980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:37.444271 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcb7c5-533e-46b2-aa5f-4bb35b41ef09 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:37.444565 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcb7c5-533e-46b2-aa5f-4bb35b41ef09 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:37.444842 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcb7c5-533e-46b2-aa5f-4bb35b41ef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:37.478553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-8fdcb7c5-533e-46b2-aa5f-4bb35b41ef09 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:37.479756 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-8fdcb7c5-533e-46b2-aa5f-4bb35b41ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:37.540326 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:37.569482 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 12/25] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:52:37.795934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404b1e3-efa5-46aa-a355-242b1962d503 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:37.927931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404b1e3-efa5-46aa-a355-242b1962d503 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:37.979260 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b5694-c600-49d8-b3e3-acc42a0c59cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:37.980296 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b5694-c600-49d8-b3e3-acc42a0c59cb None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:37.980811 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b5694-c600-49d8-b3e3-acc42a0c59cb None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:37.981292 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b5694-c600-49d8-b3e3-acc42a0c59cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:37.997527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b5694-c600-49d8-b3e3-acc42a0c59cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-8c6b5694-c600-49d8-b3e3-acc42a0c59cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:52:38.002871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:38.003704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:38.004437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:38.004437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:38.004437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:38.004437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:38.004437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:52:38.004437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:52:38.004437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:52:38.004437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:52:38.004437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:52:38.004437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:52:38.004437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:52:38.004437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:52:38.007023 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 14/26] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:52:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:52:38.014404 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcb7c5-533e-46b2-aa5f-4bb35b41ef09 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:38.025613 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedca246-427e-4106-bfbf-54c72004c136 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:38.026173 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedca246-427e-4106-bfbf-54c72004c136 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:38.026661 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedca246-427e-4106-bfbf-54c72004c136 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:38.028579 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 15/27] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:38.041045 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102d625-6b52-448d-ade9-ad7f7c56ed78 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:38.041600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102d625-6b52-448d-ade9-ad7f7c56ed78 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:38.042068 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102d625-6b52-448d-ade9-ad7f7c56ed78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:38.060532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:38.075920 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-9102d625-6b52-448d-ade9-ad7f7c56ed78 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:38.079921 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-9102d625-6b52-448d-ade9-ad7f7c56ed78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:38.160395 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 16/28] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:52:38.168333 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102d625-6b52-448d-ade9-ad7f7c56ed78 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:38.170786 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcb7c5-533e-46b2-aa5f-4bb35b41ef09 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:38.215367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eaa10-277b-435f-baf7-c69570bb585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:38.216030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eaa10-277b-435f-baf7-c69570bb585f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:38.216316 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eaa10-277b-435f-baf7-c69570bb585f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:38.216610 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eaa10-277b-435f-baf7-c69570bb585f None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:38.217717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eaa10-277b-435f-baf7-c69570bb585f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:38.218032 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eaa10-277b-435f-baf7-c69570bb585f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:38.219731 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eaa10-277b-435f-baf7-c69570bb585f None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:38.234961 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 13/29] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:52:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:38.242336 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474488a-724c-494e-9ab8-75d6d39d3849 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:38.242336 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474488a-724c-494e-9ab8-75d6d39d3849 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:38.242336 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474488a-724c-494e-9ab8-75d6d39d3849 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:38.242336 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 14/30] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:38.247513 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474488a-724c-494e-9ab8-75d6d39d3849 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:38.336051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102d625-6b52-448d-ade9-ad7f7c56ed78 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:38.347673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:38.383443 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560de5ef-251b-4434-b73d-dc8bb48a9146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:38.384450 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560de5ef-251b-4434-b73d-dc8bb48a9146 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:38.384748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560de5ef-251b-4434-b73d-dc8bb48a9146 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:38.385066 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560de5ef-251b-4434-b73d-dc8bb48a9146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:38.387033 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:38.397714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560de5ef-251b-4434-b73d-dc8bb48a9146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:38.400090 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560de5ef-251b-4434-b73d-dc8bb48a9146 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-560de5ef-251b-4434-b73d-dc8bb48a9146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:52:38.420694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:38.421572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:52:38.422444 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:52:38.422444 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:52:38.422444 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:52:38.422444 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 17/31] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:52:38.422444 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eddfb-7841-4bad-8d22-37744dedd319 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:38.422444 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eddfb-7841-4bad-8d22-37744dedd319 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:38.422444 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eddfb-7841-4bad-8d22-37744dedd319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:38.450364 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-844eddfb-7841-4bad-8d22-37744dedd319 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:38.450364 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-844eddfb-7841-4bad-8d22-37744dedd319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:38.525827 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 18/32] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:38.526598 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844eddfb-7841-4bad-8d22-37744dedd319 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:38.527510 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474488a-724c-494e-9ab8-75d6d39d3849 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:38.619776 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9963a5-61e5-4632-a127-240eead6668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:38.620358 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9963a5-61e5-4632-a127-240eead6668a None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:38.620638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9963a5-61e5-4632-a127-240eead6668a None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:38.620911 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9963a5-61e5-4632-a127-240eead6668a None admin] PATH_INFO: `/v3/users/e7a12e84a7cb44eba823234391e6a002` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:38.627373 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9963a5-61e5-4632-a127-240eead6668a None admin] RBAC: Authorizing `identity:get_user(user_id=e7a12e84a7cb44eba823234391e6a002)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:38.628843 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9963a5-61e5-4632-a127-240eead6668a None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:38.630875 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 15/33] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:52:38 2022] GET /identity/v3/users/e7a12e84a7cb44eba823234391e6a002 => generated 247 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:38.636802 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9963a5-61e5-4632-a127-240eead6668a None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:38.647045 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844eddfb-7841-4bad-8d22-37744dedd319 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:38.670337 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:38.693249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaea672-d10a-488e-869b-68a692a1cb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:38.693872 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea672-d10a-488e-869b-68a692a1cb41 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:38.694184 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea672-d10a-488e-869b-68a692a1cb41 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:38.694495 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea672-d10a-488e-869b-68a692a1cb41 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:38.695149 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaea672-d10a-488e-869b-68a692a1cb41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:38.695456 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaea672-d10a-488e-869b-68a692a1cb41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:38.697936 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaea672-d10a-488e-869b-68a692a1cb41 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:38.720385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 19/34] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:38.721285 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaea672-d10a-488e-869b-68a692a1cb41 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:38.841400 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaea672-d10a-488e-869b-68a692a1cb41 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:38.876278 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9963a5-61e5-4632-a127-240eead6668a None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:38.886534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d79c15-4f7b-407a-adcb-747faaae42d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:38.887521 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d79c15-4f7b-407a-adcb-747faaae42d9 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:38.887807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d79c15-4f7b-407a-adcb-747faaae42d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:38.888088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d79c15-4f7b-407a-adcb-747faaae42d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:38.888443 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:38.889079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d79c15-4f7b-407a-adcb-747faaae42d9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:38.890969 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d79c15-4f7b-407a-adcb-747faaae42d9 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:38.913020 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215ba6f-3acb-44c6-aae0-464a3687fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:38.913655 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215ba6f-3acb-44c6-aae0-464a3687fdaa None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:38.913936 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215ba6f-3acb-44c6-aae0-464a3687fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:38.914207 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215ba6f-3acb-44c6-aae0-464a3687fdaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:38.916002 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215ba6f-3acb-44c6-aae0-464a3687fdaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:38.917441 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215ba6f-3acb-44c6-aae0-464a3687fdaa None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:38.919232 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 16/35] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:52:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:52:38.919781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215ba6f-3acb-44c6-aae0-464a3687fdaa None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:39.023079 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215ba6f-3acb-44c6-aae0-464a3687fdaa None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:39.060951 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553cdd6-ebac-4bc2-87c2-510f539da1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:39.061597 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553cdd6-ebac-4bc2-87c2-510f539da1a4 None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:39.061904 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553cdd6-ebac-4bc2-87c2-510f539da1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:39.062183 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553cdd6-ebac-4bc2-87c2-510f539da1a4 None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:39.062894 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553cdd6-ebac-4bc2-87c2-510f539da1a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:39.064409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553cdd6-ebac-4bc2-87c2-510f539da1a4 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:39.184663 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 20/36] 10.222.0.52 () {60 vars in 1131 bytes} [Wed Aug 31 14:52:38 2022] POST /identity/v3/roles => generated 225 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:52:39.196189 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b4d2-7de1-4fc7-b6ff-c5489a611df1 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:39.206603 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b4d2-7de1-4fc7-b6ff-c5489a611df1 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:39.206603 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b4d2-7de1-4fc7-b6ff-c5489a611df1 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:39.206603 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 21/37] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:39.206603 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b4d2-7de1-4fc7-b6ff-c5489a611df1 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:39.256373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:39.303777 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 17/38] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 31 14:52:38 2022] POST /identity/v3/projects => generated 301 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:52:39.306856 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553cdd6-ebac-4bc2-87c2-510f539da1a4 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:39.338166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b4d2-7de1-4fc7-b6ff-c5489a611df1 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:39.354798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:39.395744 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fef950-d4a7-4849-8767-7f6e245e98cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:39.397256 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fef950-d4a7-4849-8767-7f6e245e98cf None admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:39.397256 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fef950-d4a7-4849-8767-7f6e245e98cf None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:39.397256 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fef950-d4a7-4849-8767-7f6e245e98cf None admin] PATH_INFO: `/v3/domains/default/users/e7a12e84a7cb44eba823234391e6a002/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:39.399446 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fef950-d4a7-4849-8767-7f6e245e98cf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e7a12e84a7cb44eba823234391e6a002, role_id=7fe1d0d9f098408c9dc7ed9fca08a4a4)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:39.401091 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fef950-d4a7-4849-8767-7f6e245e98cf None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:39.456138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553cdd6-ebac-4bc2-87c2-510f539da1a4 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:39.495907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f8ffc-82f4-4b04-a3be-26b3f22ff534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:39.496536 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8ffc-82f4-4b04-a3be-26b3f22ff534 None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:39.496819 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8ffc-82f4-4b04-a3be-26b3f22ff534 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:39.497096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8ffc-82f4-4b04-a3be-26b3f22ff534 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:39.497773 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f8ffc-82f4-4b04-a3be-26b3f22ff534 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:39.499315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f8ffc-82f4-4b04-a3be-26b3f22ff534 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:39.520979 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 22/39] 10.222.0.52 () {58 vars in 1361 bytes} [Wed Aug 31 14:52:39 2022] PUT /identity/v3/domains/default/users/e7a12e84a7cb44eba823234391e6a002/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:52:39.522221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719ffe4-fb96-43cc-bc6d-b3e8bc29805c None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:39.522548 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719ffe4-fb96-43cc-bc6d-b3e8bc29805c None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:39.522821 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719ffe4-fb96-43cc-bc6d-b3e8bc29805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:39.543857 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-c719ffe4-fb96-43cc-bc6d-b3e8bc29805c None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:39.545447 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-c719ffe4-fb96-43cc-bc6d-b3e8bc29805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:39.598613 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 18/40] 10.222.0.52 () {60 vars in 1131 bytes} [Wed Aug 31 14:52:39 2022] POST /identity/v3/roles => generated 219 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:52:39.600094 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16336-cc71-4f70-a449-87af736c140d None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:39.600384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16336-cc71-4f70-a449-87af736c140d None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:39.600664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16336-cc71-4f70-a449-87af736c140d None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:39.603309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 19/41] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:39.612549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac4e86-688f-41d7-a092-41253d58b1f3 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:39.613025 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac4e86-688f-41d7-a092-41253d58b1f3 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:39.613402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac4e86-688f-41d7-a092-41253d58b1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:39.637846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 23/42] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:39.645251 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-19ac4e86-688f-41d7-a092-41253d58b1f3 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:39.645251 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-19ac4e86-688f-41d7-a092-41253d58b1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:39.734010 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 20/43] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:39.973458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719ffe4-fb96-43cc-bc6d-b3e8bc29805c None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:40.002095 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:40.064556 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac4e86-688f-41d7-a092-41253d58b1f3 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:40.081538 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719ffe4-fb96-43cc-bc6d-b3e8bc29805c None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:40.085995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:40.117165 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34849f08-c9e9-4e65-89b4-570fc3e52458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:40.117962 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34849f08-c9e9-4e65-89b4-570fc3e52458 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:40.118374 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34849f08-c9e9-4e65-89b4-570fc3e52458 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:40.118757 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34849f08-c9e9-4e65-89b4-570fc3e52458 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:40.119555 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34849f08-c9e9-4e65-89b4-570fc3e52458 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:40.121081 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34849f08-c9e9-4e65-89b4-570fc3e52458 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:40.173083 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 24/44] 10.222.0.52 () {60 vars in 1131 bytes} [Wed Aug 31 14:52:39 2022] POST /identity/v3/roles => generated 223 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:52:40.174112 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac4e86-688f-41d7-a092-41253d58b1f3 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:40.214656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906037e-634c-4f14-b2a7-98ac4a8dd69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:40.215322 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906037e-634c-4f14-b2a7-98ac4a8dd69a None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:40.215610 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906037e-634c-4f14-b2a7-98ac4a8dd69a None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:40.215887 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906037e-634c-4f14-b2a7-98ac4a8dd69a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:40.217062 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906037e-634c-4f14-b2a7-98ac4a8dd69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:40.218585 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906037e-634c-4f14-b2a7-98ac4a8dd69a None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:40.220497 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 21/45] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:52:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:52:40.225850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34849f08-c9e9-4e65-89b4-570fc3e52458 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:40.321238 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:40.338477 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34849f08-c9e9-4e65-89b4-570fc3e52458 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:40.376551 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394752d0-edb4-4446-b9ca-498f0112b7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:40.377194 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394752d0-edb4-4446-b9ca-498f0112b7b2 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:40.377466 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394752d0-edb4-4446-b9ca-498f0112b7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:40.377748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394752d0-edb4-4446-b9ca-498f0112b7b2 None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:40.378453 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394752d0-edb4-4446-b9ca-498f0112b7b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:40.379919 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394752d0-edb4-4446-b9ca-498f0112b7b2 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:40.458462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 25/46] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 31 14:52:40 2022] POST /identity/v3/projects => generated 312 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:52:41.798807 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882726c1-c1a4-46c4-b438-504cc395ffb7 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:41.799321 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882726c1-c1a4-46c4-b438-504cc395ffb7 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:41.799439 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882726c1-c1a4-46c4-b438-504cc395ffb7 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:41.800724 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 22/47] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:41.806277 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da9e96-3e2a-4ad4-a569-81c8eb07ff09 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:41.806710 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da9e96-3e2a-4ad4-a569-81c8eb07ff09 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:41.806849 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da9e96-3e2a-4ad4-a569-81c8eb07ff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:41.825374 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-51da9e96-3e2a-4ad4-a569-81c8eb07ff09 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:41.826631 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-51da9e96-3e2a-4ad4-a569-81c8eb07ff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:41.893468 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 26/48] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:42.225696 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882726c1-c1a4-46c4-b438-504cc395ffb7 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:42.313994 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:42.330525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882726c1-c1a4-46c4-b438-504cc395ffb7 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:42.366778 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34047b2-be0e-49b1-a497-dc43b50d65d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:42.367410 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34047b2-be0e-49b1-a497-dc43b50d65d5 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:42.368267 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34047b2-be0e-49b1-a497-dc43b50d65d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:42.368560 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34047b2-be0e-49b1-a497-dc43b50d65d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:42.379740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34047b2-be0e-49b1-a497-dc43b50d65d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-a34047b2-be0e-49b1-a497-dc43b50d65d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:52:42.386140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:42.387152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:52:42.388027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 23/49] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:52:42.393091 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da9e96-3e2a-4ad4-a569-81c8eb07ff09 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:42.459300 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:42.499032 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da9e96-3e2a-4ad4-a569-81c8eb07ff09 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:42.533588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d58d0-aab7-4a34-9e95-9a4fdac38f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:42.534200 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d58d0-aab7-4a34-9e95-9a4fdac38f39 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:42.534517 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d58d0-aab7-4a34-9e95-9a4fdac38f39 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:42.534796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d58d0-aab7-4a34-9e95-9a4fdac38f39 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:42.535453 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d58d0-aab7-4a34-9e95-9a4fdac38f39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:42.535759 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d58d0-aab7-4a34-9e95-9a4fdac38f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:42.537155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d58d0-aab7-4a34-9e95-9a4fdac38f39 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:42.546023 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 27/50] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:42.551832 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34047b2-be0e-49b1-a497-dc43b50d65d5 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:42.626885 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9e754-9bb1-4eda-b14d-4d61ebd0e08b None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:42.627268 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9e754-9bb1-4eda-b14d-4d61ebd0e08b None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:42.627440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9e754-9bb1-4eda-b14d-4d61ebd0e08b None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:42.628786 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 28/51] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:52:42.634389 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfd16e-25c2-4b38-ad14-f394e57221a2 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:42.634676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfd16e-25c2-4b38-ad14-f394e57221a2 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:42.634951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfd16e-25c2-4b38-ad14-f394e57221a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:42.652999 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-cccfd16e-25c2-4b38-ad14-f394e57221a2 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:42.654198 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-cccfd16e-25c2-4b38-ad14-f394e57221a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:42.655135 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34047b2-be0e-49b1-a497-dc43b50d65d5 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:42.694805 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfd44f-1244-4741-8f11-636c0885ebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:42.695450 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfd44f-1244-4741-8f11-636c0885ebb1 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:42.695747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfd44f-1244-4741-8f11-636c0885ebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:42.696216 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfd44f-1244-4741-8f11-636c0885ebb1 None admin] PATH_INFO: `/v3/users/e7a12e84a7cb44eba823234391e6a002` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:42.697386 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfd44f-1244-4741-8f11-636c0885ebb1 None admin] RBAC: Authorizing `identity:get_user(user_id=e7a12e84a7cb44eba823234391e6a002)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:42.698906 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfd44f-1244-4741-8f11-636c0885ebb1 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:42.700539 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 24/52] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:52:42 2022] GET /identity/v3/users/e7a12e84a7cb44eba823234391e6a002 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:42.706189 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfd44f-1244-4741-8f11-636c0885ebb1 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:42.721629 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:42.726804 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 29/53] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:52:42.809100 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfd44f-1244-4741-8f11-636c0885ebb1 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:42.843391 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ec316-2c29-44f9-9a49-66067846e939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:42.844023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ec316-2c29-44f9-9a49-66067846e939 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:42.844306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ec316-2c29-44f9-9a49-66067846e939 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:42.844578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ec316-2c29-44f9-9a49-66067846e939 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:42.848090 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ec316-2c29-44f9-9a49-66067846e939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:42.849571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ec316-2c29-44f9-9a49-66067846e939 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:42.851214 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 25/54] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:52:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:52:42.857483 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfd16e-25c2-4b38-ad14-f394e57221a2 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:42.917947 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:42.958408 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfd16e-25c2-4b38-ad14-f394e57221a2 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:42.992389 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9041f04-427b-4a07-914a-49fe1fc66979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:42.993303 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9041f04-427b-4a07-914a-49fe1fc66979 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:42.993685 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9041f04-427b-4a07-914a-49fe1fc66979 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:42.993965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9041f04-427b-4a07-914a-49fe1fc66979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:42.994727 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9041f04-427b-4a07-914a-49fe1fc66979 None admin] RBAC: Adding query filter params (role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4, scope.domain.id=default, user.id=e7a12e84a7cb44eba823234391e6a002) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:42.995038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9041f04-427b-4a07-914a-49fe1fc66979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:42.996498 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9041f04-427b-4a07-914a-49fe1fc66979 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:43.002361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 30/55] 10.222.0.52 () {56 vars in 1322 bytes} [Wed Aug 31 14:52:42 2022] GET /identity/v3/role_assignments?user.id=e7a12e84a7cb44eba823234391e6a002&scope.domain.id=default&role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:43.057218 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ec316-2c29-44f9-9a49-66067846e939 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:43.142961 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:43.162900 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ec316-2c29-44f9-9a49-66067846e939 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:43.199896 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686c20d-2e00-4218-9ac2-0645a95fbadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:43.200536 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686c20d-2e00-4218-9ac2-0645a95fbadb None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:43.200821 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686c20d-2e00-4218-9ac2-0645a95fbadb None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:43.201098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686c20d-2e00-4218-9ac2-0645a95fbadb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:43.202200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686c20d-2e00-4218-9ac2-0645a95fbadb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:43.203751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686c20d-2e00-4218-9ac2-0645a95fbadb None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:43.205309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 26/56] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:52:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:43.211044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9041f04-427b-4a07-914a-49fe1fc66979 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:43.315150 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9041f04-427b-4a07-914a-49fe1fc66979 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:43.337858 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:43.347764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb8056-0038-4f63-a0a6-d8a120f37bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:43.348364 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb8056-0038-4f63-a0a6-d8a120f37bac None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:43.348645 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb8056-0038-4f63-a0a6-d8a120f37bac None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:43.348916 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb8056-0038-4f63-a0a6-d8a120f37bac None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:43.352232 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb8056-0038-4f63-a0a6-d8a120f37bac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:43.352232 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb8056-0038-4f63-a0a6-d8a120f37bac None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:43.435926 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 31/57] 10.222.0.52 () {60 vars in 1140 bytes} [Wed Aug 31 14:52:43 2022] POST /identity/v3/projects => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:52:45.591378 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2680392-9bfd-4727-aeea-1f7ae617b7b0 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:45.591926 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2680392-9bfd-4727-aeea-1f7ae617b7b0 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:45.591926 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2680392-9bfd-4727-aeea-1f7ae617b7b0 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:45.593278 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 27/58] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:45.598476 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403b417-72ba-4a6d-9c54-8c59d27228ea None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:45.598901 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403b417-72ba-4a6d-9c54-8c59d27228ea None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:45.599035 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403b417-72ba-4a6d-9c54-8c59d27228ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:45.617615 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-0403b417-72ba-4a6d-9c54-8c59d27228ea None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:45.618832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-0403b417-72ba-4a6d-9c54-8c59d27228ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:45.683248 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 32/59] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:46.007369 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2680392-9bfd-4727-aeea-1f7ae617b7b0 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:46.109416 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2680392-9bfd-4727-aeea-1f7ae617b7b0 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:46.144015 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cb6d8-0d72-4f24-bb4d-f68ea8fb230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:46.144640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cb6d8-0d72-4f24-bb4d-f68ea8fb230e None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:46.144923 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cb6d8-0d72-4f24-bb4d-f68ea8fb230e None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:46.145197 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cb6d8-0d72-4f24-bb4d-f68ea8fb230e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:46.146329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cb6d8-0d72-4f24-bb4d-f68ea8fb230e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:46.147775 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cb6d8-0d72-4f24-bb4d-f68ea8fb230e None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:46.149325 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 28/60] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:52:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:46.155692 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403b417-72ba-4a6d-9c54-8c59d27228ea None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:46.254654 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403b417-72ba-4a6d-9c54-8c59d27228ea None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:46.261956 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:46.287724 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6e7e0-43e8-45d5-8913-10a7a2b0bd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:46.288327 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e7e0-43e8-45d5-8913-10a7a2b0bd1b None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:46.288611 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e7e0-43e8-45d5-8913-10a7a2b0bd1b None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:46.288888 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e7e0-43e8-45d5-8913-10a7a2b0bd1b None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:46.289531 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6e7e0-43e8-45d5-8913-10a7a2b0bd1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:46.291613 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6e7e0-43e8-45d5-8913-10a7a2b0bd1b None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:46.394009 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 33/61] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 31 14:52:46 2022] POST /identity/v3/users => generated 275 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:52:49.830355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96079a-70e2-48cb-8b13-26d1c783668d None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:49.830875 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96079a-70e2-48cb-8b13-26d1c783668d None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:49.830948 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96079a-70e2-48cb-8b13-26d1c783668d None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:49.832601 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 29/62] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:49.840638 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb0032-ccd4-4a2e-96bb-f605d8076bb5 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:49.841095 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb0032-ccd4-4a2e-96bb-f605d8076bb5 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:49.841193 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb0032-ccd4-4a2e-96bb-f605d8076bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:49.868194 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-2bdb0032-ccd4-4a2e-96bb-f605d8076bb5 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:49.870066 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-2bdb0032-ccd4-4a2e-96bb-f605d8076bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:49.965482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 34/63] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:49.986474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8210dc-c923-45ab-9273-d0bbe0ff1859 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:49.987086 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8210dc-c923-45ab-9273-d0bbe0ff1859 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:49.987570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8210dc-c923-45ab-9273-d0bbe0ff1859 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:49.989098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 30/64] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:49.994836 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f181fd6-bfed-41d3-8324-3e7af0ae9e57 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:49.995132 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f181fd6-bfed-41d3-8324-3e7af0ae9e57 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:49.995420 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f181fd6-bfed-41d3-8324-3e7af0ae9e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:50.018533 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-2f181fd6-bfed-41d3-8324-3e7af0ae9e57 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:50.019748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-2f181fd6-bfed-41d3-8324-3e7af0ae9e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:50.078478 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aa399-d91c-4ea1-bf1c-9a9136f10dc7 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:50.078901 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aa399-d91c-4ea1-bf1c-9a9136f10dc7 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:50.079406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aa399-d91c-4ea1-bf1c-9a9136f10dc7 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:50.081018 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 31/65] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:50.093551 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d2f8f-e2e2-480a-ab6f-89ae7e525db1 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:50.094198 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d2f8f-e2e2-480a-ab6f-89ae7e525db1 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:50.094698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d2f8f-e2e2-480a-ab6f-89ae7e525db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:50.112181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 35/66] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:50.127689 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-b96d2f8f-e2e2-480a-ab6f-89ae7e525db1 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:50.128939 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-b96d2f8f-e2e2-480a-ab6f-89ae7e525db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:50.166685 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:50.218980 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 32/67] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:52:50.328261 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f181fd6-bfed-41d3-8324-3e7af0ae9e57 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:50.339021 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27a768-675a-47e3-8c89-2b298bb63d22 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:50.339290 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27a768-675a-47e3-8c89-2b298bb63d22 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:50.339577 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27a768-675a-47e3-8c89-2b298bb63d22 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:50.341175 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 33/68] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:50.346905 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dca78-c7bd-4eb8-b8da-5eaeb3a1df30 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:50.347199 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dca78-c7bd-4eb8-b8da-5eaeb3a1df30 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:50.347472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dca78-c7bd-4eb8-b8da-5eaeb3a1df30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:50.363780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:50.370979 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-530dca78-c7bd-4eb8-b8da-5eaeb3a1df30 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:50.372234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-530dca78-c7bd-4eb8-b8da-5eaeb3a1df30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:50.446695 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 34/69] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:52:50.504986 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f181fd6-bfed-41d3-8324-3e7af0ae9e57 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:50.526058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512791f8-50b5-457b-90d9-547225ac55bd None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:50.526720 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512791f8-50b5-457b-90d9-547225ac55bd None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:50.527201 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512791f8-50b5-457b-90d9-547225ac55bd None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:50.529247 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 35/70] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:50.536227 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c47c95-b34a-4413-928b-1c839dd62205 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:50.536748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c47c95-b34a-4413-928b-1c839dd62205 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:50.537347 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c47c95-b34a-4413-928b-1c839dd62205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:50.557494 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-a6c47c95-b34a-4413-928b-1c839dd62205 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:50.559043 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebca006-e9e7-444d-b940-62fed9986bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:50.559172 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-a6c47c95-b34a-4413-928b-1c839dd62205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:50.559750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebca006-e9e7-444d-b940-62fed9986bf3 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:50.560061 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebca006-e9e7-444d-b940-62fed9986bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:50.560332 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebca006-e9e7-444d-b940-62fed9986bf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:50.576043 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebca006-e9e7-444d-b940-62fed9986bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-6ebca006-e9e7-444d-b940-62fed9986bf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:52:50.582181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:50.583069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:52:50.583832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 36/71] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:52:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:52:50.584465 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebca006-e9e7-444d-b940-62fed9986bf3 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:50.639163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 36/72] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:50.640410 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c47c95-b34a-4413-928b-1c839dd62205 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:50.648706 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:50.678472 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:50.698938 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebca006-e9e7-444d-b940-62fed9986bf3 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:50.736025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d0714-7552-41d0-94f5-5e0ee595514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:50.737042 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d0714-7552-41d0-94f5-5e0ee595514b None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:50.737530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d0714-7552-41d0-94f5-5e0ee595514b None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:50.738006 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d0714-7552-41d0-94f5-5e0ee595514b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:50.749424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d0714-7552-41d0-94f5-5e0ee595514b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:52:50.749786 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c47c95-b34a-4413-928b-1c839dd62205 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-bd8d0714-7552-41d0-94f5-5e0ee595514b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:52:50.754688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:50.755511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:50.756269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:50.756269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:50.756269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:50.756269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:50.756269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:52:50.756269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:52:50.756269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:52:50.756269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:52:50.756269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:52:50.756269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:52:50.756269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:52:50.756269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:52:50.758804 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 37/73] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:52:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:52:50.760489 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d0714-7552-41d0-94f5-5e0ee595514b None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:50.792946 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2321799-41d5-4513-a7a4-9d05bda1a3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:50.793615 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2321799-41d5-4513-a7a4-9d05bda1a3bb None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:50.793903 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2321799-41d5-4513-a7a4-9d05bda1a3bb None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:50.794181 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2321799-41d5-4513-a7a4-9d05bda1a3bb None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:50.794866 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2321799-41d5-4513-a7a4-9d05bda1a3bb None admin] RBAC: Adding query filter params (name=member) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:50.795373 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2321799-41d5-4513-a7a4-9d05bda1a3bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:50.796933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2321799-41d5-4513-a7a4-9d05bda1a3bb None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:50.805985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 37/74] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:52:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:50.807940 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2321799-41d5-4513-a7a4-9d05bda1a3bb None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:50.877099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d0714-7552-41d0-94f5-5e0ee595514b None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:50.883371 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:50.912733 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a7dce-8f24-4226-a6ea-ce99f0fa3ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:50.913434 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a7dce-8f24-4226-a6ea-ce99f0fa3ba6 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:50.913720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a7dce-8f24-4226-a6ea-ce99f0fa3ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:50.914004 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a7dce-8f24-4226-a6ea-ce99f0fa3ba6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:50.919171 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2321799-41d5-4513-a7a4-9d05bda1a3bb None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:50.924288 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a7dce-8f24-4226-a6ea-ce99f0fa3ba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-256a7dce-8f24-4226-a6ea-ce99f0fa3ba6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:52:50.929172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:50.930015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:52:50.931020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 38/75] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:52:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:52:50.932499 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a7dce-8f24-4226-a6ea-ce99f0fa3ba6 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:50.935820 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:50.961076 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cec91-ebf8-474c-8c24-3e57f6b84f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:50.961984 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cec91-ebf8-474c-8c24-3e57f6b84f24 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:50.962989 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cec91-ebf8-474c-8c24-3e57f6b84f24 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:50.963439 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cec91-ebf8-474c-8c24-3e57f6b84f24 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:50.964277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cec91-ebf8-474c-8c24-3e57f6b84f24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:50.964787 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cec91-ebf8-474c-8c24-3e57f6b84f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:50.966420 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cec91-ebf8-474c-8c24-3e57f6b84f24 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:50.976662 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 38/76] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:52:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:50.977891 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cec91-ebf8-474c-8c24-3e57f6b84f24 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:51.042096 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a7dce-8f24-4226-a6ea-ce99f0fa3ba6 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:51.076683 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc8fe6-9990-46d7-af99-359ea0aeaf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:51.077308 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc8fe6-9990-46d7-af99-359ea0aeaf97 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:51.077592 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc8fe6-9990-46d7-af99-359ea0aeaf97 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:51.077864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc8fe6-9990-46d7-af99-359ea0aeaf97 None admin] PATH_INFO: `/v3/users/a1a6b4b994b043f9af0ae355141faca2` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:51.082846 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cec91-ebf8-474c-8c24-3e57f6b84f24 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:51.091300 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc8fe6-9990-46d7-af99-359ea0aeaf97 None admin] RBAC: Authorizing `identity:get_user(user_id=a1a6b4b994b043f9af0ae355141faca2)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:51.092786 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc8fe6-9990-46d7-af99-359ea0aeaf97 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:51.094452 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 39/77] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:52:50 2022] GET /identity/v3/users/a1a6b4b994b043f9af0ae355141faca2 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:51.095223 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc8fe6-9990-46d7-af99-359ea0aeaf97 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:51.115974 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:51.122907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360a1b4-36a9-4344-96e0-9457af029b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:51.142449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360a1b4-36a9-4344-96e0-9457af029b67 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:51.142449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360a1b4-36a9-4344-96e0-9457af029b67 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:51.142449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360a1b4-36a9-4344-96e0-9457af029b67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:51.142449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360a1b4-36a9-4344-96e0-9457af029b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:52:51.142449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-0360a1b4-36a9-4344-96e0-9457af029b67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:52:51.142449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:51.142449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:51.142449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:51.142449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:52:51.143001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:52:51.143751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:52:51.144566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:52:51.144566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:52:51.144566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:52:51.144566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:52:51.144566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:52:51.144566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:52:51.144566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 39/78] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:52:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:52:51.144566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360a1b4-36a9-4344-96e0-9457af029b67 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:51.157563 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:51.199594 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc8fe6-9990-46d7-af99-359ea0aeaf97 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:51.233881 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b4647-f6c4-462d-86ca-075221368736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:51.234519 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b4647-f6c4-462d-86ca-075221368736 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:51.234806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b4647-f6c4-462d-86ca-075221368736 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:51.235082 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b4647-f6c4-462d-86ca-075221368736 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:51.235738 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b4647-f6c4-462d-86ca-075221368736 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:51.236051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b4647-f6c4-462d-86ca-075221368736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:51.237445 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b4647-f6c4-462d-86ca-075221368736 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:51.245925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 40/79] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:52:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:51.246264 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360a1b4-36a9-4344-96e0-9457af029b67 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:51.246751 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b4647-f6c4-462d-86ca-075221368736 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:51.280023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34258c-55e9-42e4-9d64-0c88579abba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:51.280663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34258c-55e9-42e4-9d64-0c88579abba2 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:51.280946 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34258c-55e9-42e4-9d64-0c88579abba2 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:51.281222 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34258c-55e9-42e4-9d64-0c88579abba2 None admin] PATH_INFO: `/v3/users/e7a12e84a7cb44eba823234391e6a002` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:51.282404 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34258c-55e9-42e4-9d64-0c88579abba2 None admin] RBAC: Authorizing `identity:get_user(user_id=e7a12e84a7cb44eba823234391e6a002)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:51.283858 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34258c-55e9-42e4-9d64-0c88579abba2 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:51.285430 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 40/80] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:52:51 2022] GET /identity/v3/users/e7a12e84a7cb44eba823234391e6a002 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:51.286197 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34258c-55e9-42e4-9d64-0c88579abba2 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:51.348144 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:51.349904 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b4647-f6c4-462d-86ca-075221368736 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:51.374310 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:51.385809 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac1c40-8c8a-43c0-9d58-8aeb8ffa8500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:51.386477 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac1c40-8c8a-43c0-9d58-8aeb8ffa8500 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:51.386770 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac1c40-8c8a-43c0-9d58-8aeb8ffa8500 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:51.387049 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac1c40-8c8a-43c0-9d58-8aeb8ffa8500 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:51.388266 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac1c40-8c8a-43c0-9d58-8aeb8ffa8500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:51.389888 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac1c40-8c8a-43c0-9d58-8aeb8ffa8500 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:51.391498 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 41/81] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:52:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:51.394529 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34258c-55e9-42e4-9d64-0c88579abba2 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:51.394610 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac1c40-8c8a-43c0-9d58-8aeb8ffa8500 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:51.426851 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62aa9b-60ba-47a9-b3d9-d3dd430c6afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:51.427463 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62aa9b-60ba-47a9-b3d9-d3dd430c6afc None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:51.427745 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62aa9b-60ba-47a9-b3d9-d3dd430c6afc None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:51.428020 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62aa9b-60ba-47a9-b3d9-d3dd430c6afc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:51.494183 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62aa9b-60ba-47a9-b3d9-d3dd430c6afc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:51.495494 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac1c40-8c8a-43c0-9d58-8aeb8ffa8500 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:51.495622 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62aa9b-60ba-47a9-b3d9-d3dd430c6afc None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:51.528263 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b2a8f-025a-4de3-a9a3-1f3f4d199623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:51.528863 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b2a8f-025a-4de3-a9a3-1f3f4d199623 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:51.529142 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b2a8f-025a-4de3-a9a3-1f3f4d199623 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:51.529411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b2a8f-025a-4de3-a9a3-1f3f4d199623 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:51.530059 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b2a8f-025a-4de3-a9a3-1f3f4d199623 None admin] RBAC: Adding query filter params (name=member) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:51.530386 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b2a8f-025a-4de3-a9a3-1f3f4d199623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:51.531744 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b2a8f-025a-4de3-a9a3-1f3f4d199623 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:51.539714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 42/82] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:52:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:51.540505 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b2a8f-025a-4de3-a9a3-1f3f4d199623 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:51.553356 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:51.595051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:51.596483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 41/83] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:52:51.597318 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62aa9b-60ba-47a9-b3d9-d3dd430c6afc None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:51.642263 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b2a8f-025a-4de3-a9a3-1f3f4d199623 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:51.676005 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57eb20-439f-4b8f-b4b1-502ad04f4846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:51.676658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57eb20-439f-4b8f-b4b1-502ad04f4846 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:51.676944 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57eb20-439f-4b8f-b4b1-502ad04f4846 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:51.677220 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57eb20-439f-4b8f-b4b1-502ad04f4846 None admin] PATH_INFO: `/v3/users/a1a6b4b994b043f9af0ae355141faca2` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:51.678376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57eb20-439f-4b8f-b4b1-502ad04f4846 None admin] RBAC: Authorizing `identity:get_user(user_id=a1a6b4b994b043f9af0ae355141faca2)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:51.679817 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57eb20-439f-4b8f-b4b1-502ad04f4846 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:51.686014 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 43/84] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:52:51 2022] GET /identity/v3/users/a1a6b4b994b043f9af0ae355141faca2 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:51.686014 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57eb20-439f-4b8f-b4b1-502ad04f4846 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:51.697946 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62aa9b-60ba-47a9-b3d9-d3dd430c6afc None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:51.733553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e1226-f4a8-4d41-a63b-cdfdc4785b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:51.734167 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e1226-f4a8-4d41-a63b-cdfdc4785b18 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:51.734483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e1226-f4a8-4d41-a63b-cdfdc4785b18 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:51.734757 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e1226-f4a8-4d41-a63b-cdfdc4785b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:51.764325 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:51.799201 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57eb20-439f-4b8f-b4b1-502ad04f4846 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:51.811242 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e1226-f4a8-4d41-a63b-cdfdc4785b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:51.812803 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e1226-f4a8-4d41-a63b-cdfdc4785b18 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:51.827286 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:51.854914 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418be66-5965-44fd-b57c-ac4f05dbdbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:51.855549 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418be66-5965-44fd-b57c-ac4f05dbdbff None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:51.855837 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418be66-5965-44fd-b57c-ac4f05dbdbff None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:51.856130 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418be66-5965-44fd-b57c-ac4f05dbdbff None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:51.856794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418be66-5965-44fd-b57c-ac4f05dbdbff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:51.859025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418be66-5965-44fd-b57c-ac4f05dbdbff None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:51.926322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 44/85] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 31 14:52:51 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:52:51.926322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418be66-5965-44fd-b57c-ac4f05dbdbff None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:51.927023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 42/86] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:52:51.927023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e1226-f4a8-4d41-a63b-cdfdc4785b18 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:52.016880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:52.070511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418be66-5965-44fd-b57c-ac4f05dbdbff None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:52.074544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e1226-f4a8-4d41-a63b-cdfdc4785b18 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:52.112566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e880f2-eb29-44c2-86e5-3cb56bea2a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:52.113203 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e880f2-eb29-44c2-86e5-3cb56bea2a53 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:52.113489 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e880f2-eb29-44c2-86e5-3cb56bea2a53 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:52.113760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e880f2-eb29-44c2-86e5-3cb56bea2a53 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:52.115003 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e880f2-eb29-44c2-86e5-3cb56bea2a53 None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:52.115892 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f39d9-a9a5-4f49-8286-09638929bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:52.116447 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e880f2-eb29-44c2-86e5-3cb56bea2a53 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:52.116544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f39d9-a9a5-4f49-8286-09638929bdad None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:52.116800 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f39d9-a9a5-4f49-8286-09638929bdad None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:52.117079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f39d9-a9a5-4f49-8286-09638929bdad None admin] PATH_INFO: `/v3/users/a1a6b4b994b043f9af0ae355141faca2` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:52.118562 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 43/87] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:52:51 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:52.118947 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f39d9-a9a5-4f49-8286-09638929bdad None admin] RBAC: Authorizing `identity:get_user(user_id=a1a6b4b994b043f9af0ae355141faca2)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:52.119095 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e880f2-eb29-44c2-86e5-3cb56bea2a53 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:52.120806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f39d9-a9a5-4f49-8286-09638929bdad None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:52.123198 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 45/88] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:52:51 2022] GET /identity/v3/users/a1a6b4b994b043f9af0ae355141faca2 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:52.123198 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f39d9-a9a5-4f49-8286-09638929bdad None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:52.177313 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:52.234237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e880f2-eb29-44c2-86e5-3cb56bea2a53 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:52.247562 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f39d9-a9a5-4f49-8286-09638929bdad None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:52.267512 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:52.281651 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d7975-9aca-4c5f-afce-e84f2bf7e766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:52.282269 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7975-9aca-4c5f-afce-e84f2bf7e766 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:52.282582 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7975-9aca-4c5f-afce-e84f2bf7e766 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:52.282861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7975-9aca-4c5f-afce-e84f2bf7e766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:52.287188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cd6a8-2a01-4a25-97a8-c443b72cc156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:52.288003 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cd6a8-2a01-4a25-97a8-c443b72cc156 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:52.288425 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cd6a8-2a01-4a25-97a8-c443b72cc156 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:52.288706 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cd6a8-2a01-4a25-97a8-c443b72cc156 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:52.293649 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cd6a8-2a01-4a25-97a8-c443b72cc156 None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:52.295185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cd6a8-2a01-4a25-97a8-c443b72cc156 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:52.297077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 46/89] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:52:52 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:52.297705 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cd6a8-2a01-4a25-97a8-c443b72cc156 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:52.393901 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d7975-9aca-4c5f-afce-e84f2bf7e766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:52.396722 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d7975-9aca-4c5f-afce-e84f2bf7e766 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:52.416461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cd6a8-2a01-4a25-97a8-c443b72cc156 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:52.430451 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:52.454952 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb59366-064e-41d7-815a-007fce10b86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:52.455565 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb59366-064e-41d7-815a-007fce10b86f None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:52.455850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb59366-064e-41d7-815a-007fce10b86f None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:52.456131 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb59366-064e-41d7-815a-007fce10b86f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:52.520731 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 44/90] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:52:52.521915 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d7975-9aca-4c5f-afce-e84f2bf7e766 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:52.532313 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb59366-064e-41d7-815a-007fce10b86f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:52.533794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb59366-064e-41d7-815a-007fce10b86f None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:52.551060 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:52.638987 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d7975-9aca-4c5f-afce-e84f2bf7e766 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:52.659727 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 47/91] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:52:52.660418 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb59366-064e-41d7-815a-007fce10b86f None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:52.676655 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f7e03-ceab-4e8f-a005-2982cac844b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:52.677293 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f7e03-ceab-4e8f-a005-2982cac844b0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:52.677570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f7e03-ceab-4e8f-a005-2982cac844b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:52.677840 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f7e03-ceab-4e8f-a005-2982cac844b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:52.678678 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f7e03-ceab-4e8f-a005-2982cac844b0 None admin] RBAC: Adding query filter params (role.id=807b71faee4a435e95e2ca3296e64c2e, scope.project.id=45e07b89720a4d87bfe2ca7a011f0871, user.id=a1a6b4b994b043f9af0ae355141faca2) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:52.678984 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f7e03-ceab-4e8f-a005-2982cac844b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:52.679427 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:52.680845 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f7e03-ceab-4e8f-a005-2982cac844b0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:52.690221 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 45/92] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:52:52 2022] GET /identity/v3/role_assignments?user.id=a1a6b4b994b043f9af0ae355141faca2&scope.project.id=45e07b89720a4d87bfe2ca7a011f0871&role.id=807b71faee4a435e95e2ca3296e64c2e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:52.692337 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f7e03-ceab-4e8f-a005-2982cac844b0 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:52.835355 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb59366-064e-41d7-815a-007fce10b86f None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:52.878936 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:52.882642 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352be97-b7ab-465c-bac9-5226d48ede70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:52.884236 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352be97-b7ab-465c-bac9-5226d48ede70 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:52.884911 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352be97-b7ab-465c-bac9-5226d48ede70 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:52.885383 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352be97-b7ab-465c-bac9-5226d48ede70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:52.886309 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352be97-b7ab-465c-bac9-5226d48ede70 None admin] RBAC: Adding query filter params (role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4, scope.project.id=45e07b89720a4d87bfe2ca7a011f0871, user.id=e7a12e84a7cb44eba823234391e6a002) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:52.886827 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352be97-b7ab-465c-bac9-5226d48ede70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:52.888824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352be97-b7ab-465c-bac9-5226d48ede70 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:52.889594 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f7e03-ceab-4e8f-a005-2982cac844b0 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:52.895160 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 48/93] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:52:52 2022] GET /identity/v3/role_assignments?user.id=e7a12e84a7cb44eba823234391e6a002&scope.project.id=45e07b89720a4d87bfe2ca7a011f0871&role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:52.896151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352be97-b7ab-465c-bac9-5226d48ede70 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:52.935691 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6633950-0c83-4b03-a60e-4369294713df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:52.936373 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6633950-0c83-4b03-a60e-4369294713df None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:52.936660 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6633950-0c83-4b03-a60e-4369294713df None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:52.936898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6633950-0c83-4b03-a60e-4369294713df None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:52.938549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6633950-0c83-4b03-a60e-4369294713df None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:52.940622 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6633950-0c83-4b03-a60e-4369294713df None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:52.942405 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 46/94] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:52:52 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:52.950010 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6633950-0c83-4b03-a60e-4369294713df None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:53.087238 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:53.136201 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352be97-b7ab-465c-bac9-5226d48ede70 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:53.142319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6633950-0c83-4b03-a60e-4369294713df None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:53.180262 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee54f9c-abbd-4999-827e-8a2aa6159402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:53.186316 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee54f9c-abbd-4999-827e-8a2aa6159402 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:53.186316 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee54f9c-abbd-4999-827e-8a2aa6159402 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:53.186316 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee54f9c-abbd-4999-827e-8a2aa6159402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:53.186316 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee54f9c-abbd-4999-827e-8a2aa6159402 None admin] RBAC: Adding query filter params (role.id=a3a5839e9bda47d8af7a7b707f7a9888, scope.project.id=45e07b89720a4d87bfe2ca7a011f0871, user.id=a1a6b4b994b043f9af0ae355141faca2) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:53.186316 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee54f9c-abbd-4999-827e-8a2aa6159402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:53.186316 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee54f9c-abbd-4999-827e-8a2aa6159402 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:53.191552 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 47/95] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:52:52 2022] GET /identity/v3/role_assignments?user.id=a1a6b4b994b043f9af0ae355141faca2&scope.project.id=45e07b89720a4d87bfe2ca7a011f0871&role.id=a3a5839e9bda47d8af7a7b707f7a9888 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:53.211277 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2321e5-9880-4877-84ce-a7aaf2baca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:53.212415 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2321e5-9880-4877-84ce-a7aaf2baca82 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:53.213032 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2321e5-9880-4877-84ce-a7aaf2baca82 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:53.213507 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2321e5-9880-4877-84ce-a7aaf2baca82 None admin] PATH_INFO: `/v3/projects/1adf18164de240399beabc64abe96f18` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:53.215115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2321e5-9880-4877-84ce-a7aaf2baca82 None admin] RBAC: Authorizing `identity:get_project(project_id=1adf18164de240399beabc64abe96f18)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:53.216850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2321e5-9880-4877-84ce-a7aaf2baca82 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:53.218859 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 49/96] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:52:52 2022] GET /identity/v3/projects/1adf18164de240399beabc64abe96f18 => generated 312 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:53.224917 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee54f9c-abbd-4999-827e-8a2aa6159402 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:53.269579 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:53.379994 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee54f9c-abbd-4999-827e-8a2aa6159402 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:53.432246 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32d527-176b-4829-a69c-649d68f95066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:53.432889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32d527-176b-4829-a69c-649d68f95066 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:53.433172 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32d527-176b-4829-a69c-649d68f95066 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:53.433449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32d527-176b-4829-a69c-649d68f95066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:53.434330 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32d527-176b-4829-a69c-649d68f95066 None admin] RBAC: Adding query filter params (role.id=807b71faee4a435e95e2ca3296e64c2e, scope.project.id=1adf18164de240399beabc64abe96f18, user.id=a1a6b4b994b043f9af0ae355141faca2) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:53.434646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32d527-176b-4829-a69c-649d68f95066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:53.436151 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32d527-176b-4829-a69c-649d68f95066 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:53.445831 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 48/97] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:52:53 2022] GET /identity/v3/role_assignments?user.id=a1a6b4b994b043f9af0ae355141faca2&scope.project.id=1adf18164de240399beabc64abe96f18&role.id=807b71faee4a435e95e2ca3296e64c2e => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:54.791264 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd129f58-f252-438a-8c13-668ccb46bb5e None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:54.791945 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd129f58-f252-438a-8c13-668ccb46bb5e None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:54.791945 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd129f58-f252-438a-8c13-668ccb46bb5e None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:54.793176 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 50/98] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:54.798493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adaf74-6ac4-476d-bde6-7039eec02edd None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:54.798870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adaf74-6ac4-476d-bde6-7039eec02edd None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:54.799050 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adaf74-6ac4-476d-bde6-7039eec02edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:54.824182 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-d3adaf74-6ac4-476d-bde6-7039eec02edd None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:54.825390 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-d3adaf74-6ac4-476d-bde6-7039eec02edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:54.936193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 49/99] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:52:55.230329 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6e1a9-d49e-47e3-845a-afc82dc5a27f None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:55.230703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6e1a9-d49e-47e3-845a-afc82dc5a27f None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:55.230893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6e1a9-d49e-47e3-845a-afc82dc5a27f None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:55.232492 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 51/100] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:55.243177 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdce127-a40d-43ac-9462-de24620c7a12 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:55.243492 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdce127-a40d-43ac-9462-de24620c7a12 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:55.243782 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdce127-a40d-43ac-9462-de24620c7a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:55.266725 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-8fdce127-a40d-43ac-9462-de24620c7a12 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:55.267981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-8fdce127-a40d-43ac-9462-de24620c7a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:55.280124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:55.344532 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 50/101] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:52:55.537072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6e1a9-d49e-47e3-845a-afc82dc5a27f None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:55.683011 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6e1a9-d49e-47e3-845a-afc82dc5a27f None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:55.731014 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28494a55-a459-4d06-8f0e-ff0e674485de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:55.731660 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28494a55-a459-4d06-8f0e-ff0e674485de None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:55.731944 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28494a55-a459-4d06-8f0e-ff0e674485de None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:55.732216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28494a55-a459-4d06-8f0e-ff0e674485de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:55.750320 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28494a55-a459-4d06-8f0e-ff0e674485de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-28494a55-a459-4d06-8f0e-ff0e674485de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:52:55.752678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:55.753510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:52:55.754311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 52/102] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:52:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:52:55.760294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdce127-a40d-43ac-9462-de24620c7a12 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:55.874825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28494a55-a459-4d06-8f0e-ff0e674485de None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:55.881985 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:55.966094 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdce127-a40d-43ac-9462-de24620c7a12 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:56.006784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ecf17-6d84-4919-9773-6cd1fa19a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:56.007761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ecf17-6d84-4919-9773-6cd1fa19a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:56.008241 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ecf17-6d84-4919-9773-6cd1fa19a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:56.008756 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ecf17-6d84-4919-9773-6cd1fa19a9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:56.009815 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ecf17-6d84-4919-9773-6cd1fa19a9b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:56.010518 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ecf17-6d84-4919-9773-6cd1fa19a9b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:56.012648 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ecf17-6d84-4919-9773-6cd1fa19a9b7 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:56.023043 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 51/103] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:52:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:56.025176 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac538dc-1d28-4920-abb8-4486dbea19ee None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:56.025825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac538dc-1d28-4920-abb8-4486dbea19ee None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:56.026417 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac538dc-1d28-4920-abb8-4486dbea19ee None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:56.027854 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 52/104] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:56.029092 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac538dc-1d28-4920-abb8-4486dbea19ee None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:56.044500 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:56.066573 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28494a55-a459-4d06-8f0e-ff0e674485de None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:56.104119 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3ed5f-e96b-45fd-94a0-c15d89636ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:56.104728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3ed5f-e96b-45fd-94a0-c15d89636ed6 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:56.105017 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3ed5f-e96b-45fd-94a0-c15d89636ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:56.105294 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3ed5f-e96b-45fd-94a0-c15d89636ed6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:56.106462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3ed5f-e96b-45fd-94a0-c15d89636ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:56.107925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3ed5f-e96b-45fd-94a0-c15d89636ed6 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:56.109912 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 53/105] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:52:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:56.110864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ffb33-e071-4a12-a5ca-9c42b90e38f4 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:56.111148 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ffb33-e071-4a12-a5ca-9c42b90e38f4 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:56.111418 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ffb33-e071-4a12-a5ca-9c42b90e38f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:56.129533 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-682ffb33-e071-4a12-a5ca-9c42b90e38f4 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:56.130764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-682ffb33-e071-4a12-a5ca-9c42b90e38f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:56.166925 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac538dc-1d28-4920-abb8-4486dbea19ee None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:56.202659 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 54/106] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:56.203697 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bf1e7-8ad8-4b55-9e78-f4249e08c9c0 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:56.203990 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bf1e7-8ad8-4b55-9e78-f4249e08c9c0 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:56.204262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bf1e7-8ad8-4b55-9e78-f4249e08c9c0 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:56.209553 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 55/107] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:56.210441 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bf1e7-8ad8-4b55-9e78-f4249e08c9c0 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:56.213404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:56.213914 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa529d-7d14-4277-a535-cdd1759288ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:56.214975 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa529d-7d14-4277-a535-cdd1759288ad None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:56.216287 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa529d-7d14-4277-a535-cdd1759288ad None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:56.216863 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa529d-7d14-4277-a535-cdd1759288ad None admin] PATH_INFO: `/v3/users/ca985085e4c6488da8e47ceb10d2b930` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:56.238587 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa529d-7d14-4277-a535-cdd1759288ad None admin] RBAC: Authorizing `identity:get_user(user_id=ca985085e4c6488da8e47ceb10d2b930)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:56.240633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa529d-7d14-4277-a535-cdd1759288ad None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:56.243328 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 53/108] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:52:56 2022] GET /identity/v3/users/ca985085e4c6488da8e47ceb10d2b930 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:52:56.246015 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950de62-3ceb-4f70-abcb-e3c53b2748bb None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:56.246637 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950de62-3ceb-4f70-abcb-e3c53b2748bb None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:56.247207 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950de62-3ceb-4f70-abcb-e3c53b2748bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:56.269613 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-b950de62-3ceb-4f70-abcb-e3c53b2748bb None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:56.271859 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-b950de62-3ceb-4f70-abcb-e3c53b2748bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:56.333498 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bf1e7-8ad8-4b55-9e78-f4249e08c9c0 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:56.345961 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:56.355095 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 54/109] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:56.355720 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950de62-3ceb-4f70-abcb-e3c53b2748bb None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:56.381489 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77194e-35d8-4f37-9518-b2189e131ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:56.382634 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77194e-35d8-4f37-9518-b2189e131ec4 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:56.383150 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77194e-35d8-4f37-9518-b2189e131ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:56.383628 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77194e-35d8-4f37-9518-b2189e131ec4 None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:56.385648 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77194e-35d8-4f37-9518-b2189e131ec4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:56.387536 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77194e-35d8-4f37-9518-b2189e131ec4 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:56.502151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 56/110] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 31 14:52:56 2022] POST /identity/v3/projects => generated 302 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:52:56.530718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950de62-3ceb-4f70-abcb-e3c53b2748bb None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:56.578362 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf07932-a709-403a-bf03-417f2402a220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:56.578986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07932-a709-403a-bf03-417f2402a220 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:56.579271 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07932-a709-403a-bf03-417f2402a220 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:56.579548 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07932-a709-403a-bf03-417f2402a220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:56.673414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:56.686268 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf07932-a709-403a-bf03-417f2402a220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:56.687784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf07932-a709-403a-bf03-417f2402a220 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:56.762658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77194e-35d8-4f37-9518-b2189e131ec4 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:56.860772 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 55/111] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:52:56.867466 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf07932-a709-403a-bf03-417f2402a220 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:56.892729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:56.949915 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77194e-35d8-4f37-9518-b2189e131ec4 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:56.992362 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44c03e-600e-4f5c-975a-8eb8151692aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:56.993008 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c03e-600e-4f5c-975a-8eb8151692aa None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:56.993290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c03e-600e-4f5c-975a-8eb8151692aa None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:56.993613 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c03e-600e-4f5c-975a-8eb8151692aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:56.999542 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:57.006555 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf07932-a709-403a-bf03-417f2402a220 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:57.008245 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44c03e-600e-4f5c-975a-8eb8151692aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-2b44c03e-600e-4f5c-975a-8eb8151692aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:52:57.014403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:57.015482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:57.016442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:57.016442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:57.016442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:57.016442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:57.016442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:52:57.016442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:52:57.016442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:52:57.016442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:52:57.016442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:52:57.016442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:52:57.016442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:52:57.016442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:52:57.018374 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 57/112] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:52:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:52:57.019293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44c03e-600e-4f5c-975a-8eb8151692aa None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:57.075619 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130931a-b852-4696-a206-7a02dbc147a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:57.076298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130931a-b852-4696-a206-7a02dbc147a9 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:57.076584 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130931a-b852-4696-a206-7a02dbc147a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:57.076858 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130931a-b852-4696-a206-7a02dbc147a9 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:57.078048 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130931a-b852-4696-a206-7a02dbc147a9 None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:57.079553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130931a-b852-4696-a206-7a02dbc147a9 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:57.081346 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 56/113] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:52:56 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:52:57.082499 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa564f-5346-4527-bbde-b7c01ac9d712 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:57.082784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa564f-5346-4527-bbde-b7c01ac9d712 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:57.083058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa564f-5346-4527-bbde-b7c01ac9d712 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:57.084452 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 57/114] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:57.089408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa564f-5346-4527-bbde-b7c01ac9d712 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:57.149247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44c03e-600e-4f5c-975a-8eb8151692aa None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:57.165070 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:57.186793 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43c039-d69c-4768-91f6-990374740030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:57.187756 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43c039-d69c-4768-91f6-990374740030 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:57.188182 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43c039-d69c-4768-91f6-990374740030 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:57.188621 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43c039-d69c-4768-91f6-990374740030 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:57.193944 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa564f-5346-4527-bbde-b7c01ac9d712 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:57.201480 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43c039-d69c-4768-91f6-990374740030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-1e43c039-d69c-4768-91f6-990374740030 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:52:57.206933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:57.207966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:57.208895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:57.208895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:57.208895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:57.208895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:57.208895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:52:57.208895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:52:57.208895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:52:57.208895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:52:57.208895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:52:57.208895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:52:57.208895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:52:57.208895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:52:57.210918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 58/115] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:52:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:52:57.212805 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b02d56-3468-4efe-a118-d86fff1c7330 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:57.213093 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b02d56-3468-4efe-a118-d86fff1c7330 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:57.213370 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b02d56-3468-4efe-a118-d86fff1c7330 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:57.214653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 59/116] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:57.215338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b02d56-3468-4efe-a118-d86fff1c7330 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:57.239523 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c7a92-2797-4aa4-9bdc-5ffa621ea7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:57.240142 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c7a92-2797-4aa4-9bdc-5ffa621ea7d0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:57.240430 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c7a92-2797-4aa4-9bdc-5ffa621ea7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:57.240705 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c7a92-2797-4aa4-9bdc-5ffa621ea7d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:57.241364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c7a92-2797-4aa4-9bdc-5ffa621ea7d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:57.241669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c7a92-2797-4aa4-9bdc-5ffa621ea7d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:57.243084 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c7a92-2797-4aa4-9bdc-5ffa621ea7d0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:57.251774 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 58/117] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:52:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:57.252950 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd6e6-e9f2-4792-a646-15b4907eda78 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:57.253239 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd6e6-e9f2-4792-a646-15b4907eda78 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:57.253513 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd6e6-e9f2-4792-a646-15b4907eda78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:57.272754 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-0a4bd6e6-e9f2-4792-a646-15b4907eda78 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:57.273946 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-0a4bd6e6-e9f2-4792-a646-15b4907eda78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:57.297376 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:57.332227 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b02d56-3468-4efe-a118-d86fff1c7330 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:57.354592 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 59/118] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:57.355648 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd6e6-e9f2-4792-a646-15b4907eda78 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:57.369051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3945bd-f6cb-4345-98c7-fb8e65ffa08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:57.369719 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3945bd-f6cb-4345-98c7-fb8e65ffa08e None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:57.370011 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3945bd-f6cb-4345-98c7-fb8e65ffa08e None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:57.370285 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3945bd-f6cb-4345-98c7-fb8e65ffa08e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:57.371146 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3945bd-f6cb-4345-98c7-fb8e65ffa08e None admin] RBAC: Adding query filter params (role.id=6e5c958fa3a9494db4490551ae5253a9, scope.project.id=45e07b89720a4d87bfe2ca7a011f0871, user.id=ca985085e4c6488da8e47ceb10d2b930) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:57.371459 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3945bd-f6cb-4345-98c7-fb8e65ffa08e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:57.373087 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3945bd-f6cb-4345-98c7-fb8e65ffa08e None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:57.379009 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 60/119] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:52:57 2022] GET /identity/v3/role_assignments?user.id=ca985085e4c6488da8e47ceb10d2b930&scope.project.id=45e07b89720a4d87bfe2ca7a011f0871&role.id=6e5c958fa3a9494db4490551ae5253a9 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:57.387912 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a27af-bfda-42b3-8b5c-b7ae7f756b58 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:57.388229 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a27af-bfda-42b3-8b5c-b7ae7f756b58 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:57.388481 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a27af-bfda-42b3-8b5c-b7ae7f756b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:57.426128 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-c28a27af-bfda-42b3-8b5c-b7ae7f756b58 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:57.427460 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-c28a27af-bfda-42b3-8b5c-b7ae7f756b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:57.486110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd6e6-e9f2-4792-a646-15b4907eda78 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:57.502692 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:57.532087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eff0ee-ac13-43b3-b124-bda122981782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:57.533247 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff0ee-ac13-43b3-b124-bda122981782 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:57.533535 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff0ee-ac13-43b3-b124-bda122981782 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:57.533812 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff0ee-ac13-43b3-b124-bda122981782 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:57.534525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eff0ee-ac13-43b3-b124-bda122981782 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:57.534831 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eff0ee-ac13-43b3-b124-bda122981782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:57.536554 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eff0ee-ac13-43b3-b124-bda122981782 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:57.548533 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 60/120] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:52:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:57.549869 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eff0ee-ac13-43b3-b124-bda122981782 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:57.579499 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:57.597495 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 61/121] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:52:57.598226 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a27af-bfda-42b3-8b5c-b7ae7f756b58 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:57.685786 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eff0ee-ac13-43b3-b124-bda122981782 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:57.733862 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52368bf9-3b3b-43db-a451-8139a660411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:57.734538 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52368bf9-3b3b-43db-a451-8139a660411c None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:57.734822 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52368bf9-3b3b-43db-a451-8139a660411c None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:57.735094 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52368bf9-3b3b-43db-a451-8139a660411c None admin] PATH_INFO: `/v3/users/a1a6b4b994b043f9af0ae355141faca2` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:57.736348 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52368bf9-3b3b-43db-a451-8139a660411c None admin] RBAC: Authorizing `identity:get_user(user_id=a1a6b4b994b043f9af0ae355141faca2)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:57.737987 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52368bf9-3b3b-43db-a451-8139a660411c None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:57.739758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 61/122] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:52:57 2022] GET /identity/v3/users/a1a6b4b994b043f9af0ae355141faca2 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:57.741199 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52368bf9-3b3b-43db-a451-8139a660411c None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:57.779290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a27af-bfda-42b3-8b5c-b7ae7f756b58 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:57.825981 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e064d2-1bf4-4de8-82f2-913494be0745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:57.827042 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e064d2-1bf4-4de8-82f2-913494be0745 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:57.827656 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e064d2-1bf4-4de8-82f2-913494be0745 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:57.828129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e064d2-1bf4-4de8-82f2-913494be0745 None admin] PATH_INFO: `/v3/users/e7a12e84a7cb44eba823234391e6a002` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:57.829509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e064d2-1bf4-4de8-82f2-913494be0745 None admin] RBAC: Authorizing `identity:get_user(user_id=e7a12e84a7cb44eba823234391e6a002)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:57.831214 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e064d2-1bf4-4de8-82f2-913494be0745 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:57.833308 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 62/123] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:52:57 2022] GET /identity/v3/users/e7a12e84a7cb44eba823234391e6a002 => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:57.834350 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e064d2-1bf4-4de8-82f2-913494be0745 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:57.895372 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:57.900179 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:57.938773 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52368bf9-3b3b-43db-a451-8139a660411c None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:57.986252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e064d2-1bf4-4de8-82f2-913494be0745 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:58.031474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3229a-2b10-4023-ba57-9701e7318586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:58.032817 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3229a-2b10-4023-ba57-9701e7318586 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:58.034048 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3229a-2b10-4023-ba57-9701e7318586 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:58.035420 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c301353-bdde-415c-8477-5968807e7e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:58.036280 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3229a-2b10-4023-ba57-9701e7318586 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:58.037957 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c301353-bdde-415c-8477-5968807e7e44 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:58.038607 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c301353-bdde-415c-8477-5968807e7e44 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:58.039656 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c301353-bdde-415c-8477-5968807e7e44 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:58.043857 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c301353-bdde-415c-8477-5968807e7e44 None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:58.045887 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c301353-bdde-415c-8477-5968807e7e44 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:58.051728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 63/124] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:52:57 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:58.053138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c301353-bdde-415c-8477-5968807e7e44 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:58.062672 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3229a-2b10-4023-ba57-9701e7318586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-c8f3229a-2b10-4023-ba57-9701e7318586 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:52:58.067811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:58.068781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:52:58.069530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 62/125] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:52:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:52:58.070167 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3229a-2b10-4023-ba57-9701e7318586 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:58.190004 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c301353-bdde-415c-8477-5968807e7e44 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:58.195354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:58.201739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3229a-2b10-4023-ba57-9701e7318586 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:58.233850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdbf60-3cb9-408d-87e3-e0711b21fea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:58.234697 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdbf60-3cb9-408d-87e3-e0711b21fea3 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:58.235404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdbf60-3cb9-408d-87e3-e0711b21fea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:58.235805 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdbf60-3cb9-408d-87e3-e0711b21fea3 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:58.237321 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdbf60-3cb9-408d-87e3-e0711b21fea3 None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:58.240138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdbf60-3cb9-408d-87e3-e0711b21fea3 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:58.243880 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 64/126] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:52:58 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:58.245111 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdbf60-3cb9-408d-87e3-e0711b21fea3 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:58.247553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cedb0-9a4b-45c4-bd3a-7e9cc03c22c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:58.248672 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cedb0-9a4b-45c4-bd3a-7e9cc03c22c0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:58.250198 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cedb0-9a4b-45c4-bd3a-7e9cc03c22c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:58.250665 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cedb0-9a4b-45c4-bd3a-7e9cc03c22c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:58.264030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cedb0-9a4b-45c4-bd3a-7e9cc03c22c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-fc6cedb0-9a4b-45c4-bd3a-7e9cc03c22c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:52:58.270480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:52:58.271519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:52:58.272309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:52:58.272309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:52:58.272309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:52:58.272309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:52:58.272309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:52:58.272309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:52:58.272309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:52:58.272309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:52:58.272309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:52:58.272309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:52:58.272309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:52:58.272309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:52:58.275392 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 63/127] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:52:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:52:58.281130 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cedb0-9a4b-45c4-bd3a-7e9cc03c22c0 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:58.293080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:58.384635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdbf60-3cb9-408d-87e3-e0711b21fea3 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:58.429926 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f79a5e-164d-4475-8e74-6cbb4ba1d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:58.430135 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cedb0-9a4b-45c4-bd3a-7e9cc03c22c0 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:58.431035 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f79a5e-164d-4475-8e74-6cbb4ba1d931 None admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:58.431498 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f79a5e-164d-4475-8e74-6cbb4ba1d931 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:58.431916 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f79a5e-164d-4475-8e74-6cbb4ba1d931 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871/users/a1a6b4b994b043f9af0ae355141faca2/roles/807b71faee4a435e95e2ca3296e64c2e` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:58.435398 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f79a5e-164d-4475-8e74-6cbb4ba1d931 None admin] RBAC: Authorizing `identity:create_grant(project_id=45e07b89720a4d87bfe2ca7a011f0871, user_id=a1a6b4b994b043f9af0ae355141faca2, role_id=807b71faee4a435e95e2ca3296e64c2e)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:58.437075 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f79a5e-164d-4475-8e74-6cbb4ba1d931 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:58.470970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2287a7-641e-4958-a267-4b18c06cb5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:58.471685 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2287a7-641e-4958-a267-4b18c06cb5b8 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:58.472040 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2287a7-641e-4958-a267-4b18c06cb5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:58.472386 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2287a7-641e-4958-a267-4b18c06cb5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:58.473207 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2287a7-641e-4958-a267-4b18c06cb5b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:58.473578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2287a7-641e-4958-a267-4b18c06cb5b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:58.475174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2287a7-641e-4958-a267-4b18c06cb5b8 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:58.486875 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 64/128] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:52:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:58.492687 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2287a7-641e-4958-a267-4b18c06cb5b8 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:58.500265 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 65/129] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:52:58 2022] PUT /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871/users/a1a6b4b994b043f9af0ae355141faca2/roles/807b71faee4a435e95e2ca3296e64c2e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:52:58.507958 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f79a5e-164d-4475-8e74-6cbb4ba1d931 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:58.589177 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:58.644472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:58.714481 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2287a7-641e-4958-a267-4b18c06cb5b8 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:58.763773 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17d2af-0150-4b3f-80eb-e1be6b27f3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:58.764812 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17d2af-0150-4b3f-80eb-e1be6b27f3a9 None admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:58.764918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f79a5e-164d-4475-8e74-6cbb4ba1d931 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:58.765420 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17d2af-0150-4b3f-80eb-e1be6b27f3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:58.765900 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17d2af-0150-4b3f-80eb-e1be6b27f3a9 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871/users/e7a12e84a7cb44eba823234391e6a002/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:58.769107 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17d2af-0150-4b3f-80eb-e1be6b27f3a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=45e07b89720a4d87bfe2ca7a011f0871, user_id=e7a12e84a7cb44eba823234391e6a002, role_id=7fe1d0d9f098408c9dc7ed9fca08a4a4)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:58.770848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17d2af-0150-4b3f-80eb-e1be6b27f3a9 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:58.820465 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ec6e5-5eba-4120-b06c-889119d62db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:58.821170 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ec6e5-5eba-4120-b06c-889119d62db2 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:58.821570 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ec6e5-5eba-4120-b06c-889119d62db2 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:58.821981 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ec6e5-5eba-4120-b06c-889119d62db2 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:58.822688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ec6e5-5eba-4120-b06c-889119d62db2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:52:58.823047 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ec6e5-5eba-4120-b06c-889119d62db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:58.824494 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ec6e5-5eba-4120-b06c-889119d62db2 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:58.833815 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 66/130] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:52:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:58.834677 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ec6e5-5eba-4120-b06c-889119d62db2 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:58.882137 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 65/131] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:52:58 2022] PUT /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871/users/e7a12e84a7cb44eba823234391e6a002/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:52:58.891203 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17d2af-0150-4b3f-80eb-e1be6b27f3a9 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:58.964398 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:58.980220 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ec6e5-5eba-4120-b06c-889119d62db2 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:59.057899 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe8819-ed6f-4fe7-a4ff-13e116497827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:59.058495 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe8819-ed6f-4fe7-a4ff-13e116497827 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:59.058784 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe8819-ed6f-4fe7-a4ff-13e116497827 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:59.059112 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe8819-ed6f-4fe7-a4ff-13e116497827 None admin] PATH_INFO: `/v3/users/a1a6b4b994b043f9af0ae355141faca2` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:59.060349 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe8819-ed6f-4fe7-a4ff-13e116497827 None admin] RBAC: Authorizing `identity:get_user(user_id=a1a6b4b994b043f9af0ae355141faca2)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:59.062073 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe8819-ed6f-4fe7-a4ff-13e116497827 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:59.063718 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 67/132] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:52:58 2022] GET /identity/v3/users/a1a6b4b994b043f9af0ae355141faca2 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:59.069389 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe8819-ed6f-4fe7-a4ff-13e116497827 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:59.113408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17d2af-0150-4b3f-80eb-e1be6b27f3a9 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:59.150485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:59.162061 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0549a35-681e-4e22-8f92-a15658c55152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:59.163097 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0549a35-681e-4e22-8f92-a15658c55152 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:59.163585 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0549a35-681e-4e22-8f92-a15658c55152 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:59.164116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0549a35-681e-4e22-8f92-a15658c55152 None admin] PATH_INFO: `/v3/users/a1a6b4b994b043f9af0ae355141faca2` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:59.166278 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0549a35-681e-4e22-8f92-a15658c55152 None admin] RBAC: Authorizing `identity:get_user(user_id=a1a6b4b994b043f9af0ae355141faca2)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:59.168320 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0549a35-681e-4e22-8f92-a15658c55152 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:59.170550 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 66/133] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:52:58 2022] GET /identity/v3/users/a1a6b4b994b043f9af0ae355141faca2 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:52:59.176692 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0549a35-681e-4e22-8f92-a15658c55152 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:59.305393 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0549a35-681e-4e22-8f92-a15658c55152 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:59.325558 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe8819-ed6f-4fe7-a4ff-13e116497827 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:59.350477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1a0bc-4c32-44dc-9678-498f539e405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:59.351589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1a0bc-4c32-44dc-9678-498f539e405d None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:59.352123 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1a0bc-4c32-44dc-9678-498f539e405d None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:59.353283 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1a0bc-4c32-44dc-9678-498f539e405d None admin] PATH_INFO: `/v3/projects/1adf18164de240399beabc64abe96f18` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:59.355078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1a0bc-4c32-44dc-9678-498f539e405d None admin] RBAC: Authorizing `identity:get_project(project_id=1adf18164de240399beabc64abe96f18)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:59.357233 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1a0bc-4c32-44dc-9678-498f539e405d None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:59.360125 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 67/134] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:52:59 2022] GET /identity/v3/projects/1adf18164de240399beabc64abe96f18 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:52:59.366826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1a0bc-4c32-44dc-9678-498f539e405d None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:59.375229 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad39f3c-786f-45f3-bfe2-e4088b2d82e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:59.376168 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad39f3c-786f-45f3-bfe2-e4088b2d82e1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:59.376678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad39f3c-786f-45f3-bfe2-e4088b2d82e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:59.377153 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad39f3c-786f-45f3-bfe2-e4088b2d82e1 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:59.379147 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad39f3c-786f-45f3-bfe2-e4088b2d82e1 None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:59.381734 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad39f3c-786f-45f3-bfe2-e4088b2d82e1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:59.384220 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 68/135] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:52:59 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:52:59.395457 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad39f3c-786f-45f3-bfe2-e4088b2d82e1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:52:59.462702 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:59.490498 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:52:59.550839 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1a0bc-4c32-44dc-9678-498f539e405d None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:59.573662 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad39f3c-786f-45f3-bfe2-e4088b2d82e1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:52:59.612877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15136378-5095-485e-81fc-b45dd427755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:59.613987 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15136378-5095-485e-81fc-b45dd427755b None admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:59.614525 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15136378-5095-485e-81fc-b45dd427755b None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:59.615027 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15136378-5095-485e-81fc-b45dd427755b None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871/users/a1a6b4b994b043f9af0ae355141faca2/roles/a3a5839e9bda47d8af7a7b707f7a9888` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:59.617503 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15136378-5095-485e-81fc-b45dd427755b None admin] RBAC: Authorizing `identity:create_grant(project_id=45e07b89720a4d87bfe2ca7a011f0871, user_id=a1a6b4b994b043f9af0ae355141faca2, role_id=a3a5839e9bda47d8af7a7b707f7a9888)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:59.619757 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15136378-5095-485e-81fc-b45dd427755b None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:59.623012 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd841ec1-76c1-4e4e-852f-dae6cb333627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:52:59.625729 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd841ec1-76c1-4e4e-852f-dae6cb333627 None admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:59.626920 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd841ec1-76c1-4e4e-852f-dae6cb333627 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:59.627623 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd841ec1-76c1-4e4e-852f-dae6cb333627 None admin] PATH_INFO: `/v3/projects/1adf18164de240399beabc64abe96f18/users/a1a6b4b994b043f9af0ae355141faca2/roles/807b71faee4a435e95e2ca3296e64c2e` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:59.630079 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd841ec1-76c1-4e4e-852f-dae6cb333627 None admin] RBAC: Authorizing `identity:create_grant(project_id=1adf18164de240399beabc64abe96f18, user_id=a1a6b4b994b043f9af0ae355141faca2, role_id=807b71faee4a435e95e2ca3296e64c2e)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:52:59.631771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd841ec1-76c1-4e4e-852f-dae6cb333627 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:52:59.709465 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 69/136] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:52:59 2022] PUT /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871/users/a1a6b4b994b043f9af0ae355141faca2/roles/a3a5839e9bda47d8af7a7b707f7a9888 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:52:59.711432 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb767e8-52b2-4b1b-aca3-14049bf4924d None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:59.712469 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb767e8-52b2-4b1b-aca3-14049bf4924d None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:59.713272 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb767e8-52b2-4b1b-aca3-14049bf4924d None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:59.715025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 70/137] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:52:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:52:59.724046 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f51eb-1ffa-4308-a696-371d9f3248ac None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:52:59.724838 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f51eb-1ffa-4308-a696-371d9f3248ac None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:52:59.725334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f51eb-1ffa-4308-a696-371d9f3248ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:52:59.738164 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 68/138] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:52:59 2022] PUT /identity/v3/projects/1adf18164de240399beabc64abe96f18/users/a1a6b4b994b043f9af0ae355141faca2/roles/807b71faee4a435e95e2ca3296e64c2e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:52:59.765440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-5a0f51eb-1ffa-4308-a696-371d9f3248ac None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:52:59.767156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-5a0f51eb-1ffa-4308-a696-371d9f3248ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:52:59.852968 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 71/139] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:00.279040 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd841ec1-76c1-4e4e-852f-dae6cb333627 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:00.411011 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd841ec1-76c1-4e4e-852f-dae6cb333627 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:00.441150 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:00.453406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca3a8b-31aa-4bbe-b7d2-ebdf41370d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:00.454428 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca3a8b-31aa-4bbe-b7d2-ebdf41370d33 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:00.454881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca3a8b-31aa-4bbe-b7d2-ebdf41370d33 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:00.455322 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca3a8b-31aa-4bbe-b7d2-ebdf41370d33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:00.456676 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca3a8b-31aa-4bbe-b7d2-ebdf41370d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:00.463198 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca3a8b-31aa-4bbe-b7d2-ebdf41370d33 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:00.463198 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 69/140] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:00.465253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183027e4-fa8b-45e5-8fd3-8128a67ba26e None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:00.466097 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183027e4-fa8b-45e5-8fd3-8128a67ba26e None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:00.466595 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183027e4-fa8b-45e5-8fd3-8128a67ba26e None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:00.469158 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 72/141] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:00.473159 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd199337-098c-4b4d-94d3-c52e36af5950 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:00.473661 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd199337-098c-4b4d-94d3-c52e36af5950 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:00.474208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd199337-098c-4b4d-94d3-c52e36af5950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:00.478930 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca3a8b-31aa-4bbe-b7d2-ebdf41370d33 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:00.506554 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-fd199337-098c-4b4d-94d3-c52e36af5950 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:00.507784 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-fd199337-098c-4b4d-94d3-c52e36af5950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:00.565536 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:00.596685 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca3a8b-31aa-4bbe-b7d2-ebdf41370d33 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:00.636449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20975b-8ee6-457e-8ba3-4b9e984a6438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:00.637530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20975b-8ee6-457e-8ba3-4b9e984a6438 None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:00.638024 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20975b-8ee6-457e-8ba3-4b9e984a6438 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:00.638534 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20975b-8ee6-457e-8ba3-4b9e984a6438 None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:00.639519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20975b-8ee6-457e-8ba3-4b9e984a6438 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:00.641210 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20975b-8ee6-457e-8ba3-4b9e984a6438 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:00.652871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 73/142] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:00.801454 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 70/143] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 31 14:53:00 2022] POST /identity/v3/users => generated 283 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:53:01.127934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd199337-098c-4b4d-94d3-c52e36af5950 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:01.241528 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd199337-098c-4b4d-94d3-c52e36af5950 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:01.285751 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c341bd2-6ab6-45f0-bdd3-1e7e35976a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:01.286449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341bd2-6ab6-45f0-bdd3-1e7e35976a49 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:01.286732 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341bd2-6ab6-45f0-bdd3-1e7e35976a49 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:01.287005 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341bd2-6ab6-45f0-bdd3-1e7e35976a49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:01.299858 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c341bd2-6ab6-45f0-bdd3-1e7e35976a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-9c341bd2-6ab6-45f0-bdd3-1e7e35976a49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:01.308984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:01.309897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:01.311138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 74/144] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:01.319407 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20975b-8ee6-457e-8ba3-4b9e984a6438 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:01.384178 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:01.448118 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20975b-8ee6-457e-8ba3-4b9e984a6438 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:01.501217 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e16fec-fdeb-4758-b74a-85cd0d7eb1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:01.501844 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e16fec-fdeb-4758-b74a-85cd0d7eb1b7 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:01.502129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e16fec-fdeb-4758-b74a-85cd0d7eb1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:01.502432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e16fec-fdeb-4758-b74a-85cd0d7eb1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:01.503108 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e16fec-fdeb-4758-b74a-85cd0d7eb1b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:01.503416 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e16fec-fdeb-4758-b74a-85cd0d7eb1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:01.504788 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e16fec-fdeb-4758-b74a-85cd0d7eb1b7 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:01.514547 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 71/145] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:01.520142 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c341bd2-6ab6-45f0-bdd3-1e7e35976a49 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:01.533635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:01.646517 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c341bd2-6ab6-45f0-bdd3-1e7e35976a49 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:01.688936 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff8c8b-4d17-47a8-8f97-7b213b0262c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:01.689946 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff8c8b-4d17-47a8-8f97-7b213b0262c2 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:01.690562 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff8c8b-4d17-47a8-8f97-7b213b0262c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:01.691117 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff8c8b-4d17-47a8-8f97-7b213b0262c2 None admin] PATH_INFO: `/v3/users/ca985085e4c6488da8e47ceb10d2b930` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:01.692940 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff8c8b-4d17-47a8-8f97-7b213b0262c2 None admin] RBAC: Authorizing `identity:get_user(user_id=ca985085e4c6488da8e47ceb10d2b930)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:01.694705 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff8c8b-4d17-47a8-8f97-7b213b0262c2 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:01.696927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 75/146] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:01 2022] GET /identity/v3/users/ca985085e4c6488da8e47ceb10d2b930 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:01.703128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e16fec-fdeb-4758-b74a-85cd0d7eb1b7 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:01.733285 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f049a29-b04a-421d-944f-753256174fe4 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:01.733927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f049a29-b04a-421d-944f-753256174fe4 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:01.734538 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f049a29-b04a-421d-944f-753256174fe4 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:01.736162 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 76/147] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:01.741454 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69103d-983d-4d9d-9fa8-8ccd67221e9b None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:01.742041 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69103d-983d-4d9d-9fa8-8ccd67221e9b None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:01.742576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69103d-983d-4d9d-9fa8-8ccd67221e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:01.773429 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-6b69103d-983d-4d9d-9fa8-8ccd67221e9b None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:01.775149 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-6b69103d-983d-4d9d-9fa8-8ccd67221e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:01.833699 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e16fec-fdeb-4758-b74a-85cd0d7eb1b7 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:01.858011 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:01.884324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110a60-f0cf-4977-bf47-65231d99697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:01.889418 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110a60-f0cf-4977-bf47-65231d99697a None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:01.889418 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110a60-f0cf-4977-bf47-65231d99697a None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:01.889418 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110a60-f0cf-4977-bf47-65231d99697a None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:01.889418 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6110a60-f0cf-4977-bf47-65231d99697a None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:01.889418 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6110a60-f0cf-4977-bf47-65231d99697a None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:01.890271 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 72/148] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:01 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:01.894026 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 77/149] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:01.896386 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110a60-f0cf-4977-bf47-65231d99697a None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:02.009124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110a60-f0cf-4977-bf47-65231d99697a None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:02.052776 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b1e14-64c7-43a9-be77-e4998d14c1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:02.053823 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b1e14-64c7-43a9-be77-e4998d14c1cc None admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:02.054355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b1e14-64c7-43a9-be77-e4998d14c1cc None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:02.054849 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b1e14-64c7-43a9-be77-e4998d14c1cc None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871/users/ca985085e4c6488da8e47ceb10d2b930/roles/6e5c958fa3a9494db4490551ae5253a9` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:02.057366 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b1e14-64c7-43a9-be77-e4998d14c1cc None admin] RBAC: Authorizing `identity:create_grant(project_id=45e07b89720a4d87bfe2ca7a011f0871, user_id=ca985085e4c6488da8e47ceb10d2b930, role_id=6e5c958fa3a9494db4490551ae5253a9)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:02.060211 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b1e14-64c7-43a9-be77-e4998d14c1cc None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:02.126154 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 73/150] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:53:01 2022] PUT /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871/users/ca985085e4c6488da8e47ceb10d2b930/roles/6e5c958fa3a9494db4490551ae5253a9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:53:02.334203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69103d-983d-4d9d-9fa8-8ccd67221e9b None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:02.346804 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:02.463454 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69103d-983d-4d9d-9fa8-8ccd67221e9b None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:02.517026 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b76b5-a5e1-44ba-8f85-1d24ce9a0c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:02.517673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b76b5-a5e1-44ba-8f85-1d24ce9a0c82 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:02.519359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b76b5-a5e1-44ba-8f85-1d24ce9a0c82 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:02.519359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b76b5-a5e1-44ba-8f85-1d24ce9a0c82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:02.534926 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b76b5-a5e1-44ba-8f85-1d24ce9a0c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-c06b76b5-a5e1-44ba-8f85-1d24ce9a0c82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:02.540054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:02.541422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:02.542233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 78/151] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:02.547861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b1e14-64c7-43a9-be77-e4998d14c1cc None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:02.600809 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:02.681453 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b1e14-64c7-43a9-be77-e4998d14c1cc None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:02.722364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9a166-8f42-444f-80dc-4910d5ac996d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:02.723085 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9a166-8f42-444f-80dc-4910d5ac996d None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:02.723372 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9a166-8f42-444f-80dc-4910d5ac996d None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:02.723649 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9a166-8f42-444f-80dc-4910d5ac996d None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:02.724320 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9a166-8f42-444f-80dc-4910d5ac996d None admin] RBAC: Adding query filter params (name=member) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:02.724623 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9a166-8f42-444f-80dc-4910d5ac996d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:02.725997 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9a166-8f42-444f-80dc-4910d5ac996d None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:02.738564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 74/152] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:02.744949 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b76b5-a5e1-44ba-8f85-1d24ce9a0c82 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:02.832145 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:02.847462 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cc1de-6e84-4629-bee3-a43643a89b45 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:02.847462 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cc1de-6e84-4629-bee3-a43643a89b45 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:02.847462 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cc1de-6e84-4629-bee3-a43643a89b45 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:02.847462 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 75/153] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:02.855749 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b503bcd-1580-4182-bd76-dd8cc71aed81 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:02.856043 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b503bcd-1580-4182-bd76-dd8cc71aed81 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:02.856390 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b503bcd-1580-4182-bd76-dd8cc71aed81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:02.871374 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b76b5-a5e1-44ba-8f85-1d24ce9a0c82 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:02.894510 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-7b503bcd-1580-4182-bd76-dd8cc71aed81 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:02.895854 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-7b503bcd-1580-4182-bd76-dd8cc71aed81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:02.914984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c1a86-4e04-48f5-ae7f-e844ffa71d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:02.916279 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1a86-4e04-48f5-ae7f-e844ffa71d5a None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:02.916558 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1a86-4e04-48f5-ae7f-e844ffa71d5a None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:02.916831 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1a86-4e04-48f5-ae7f-e844ffa71d5a None admin] PATH_INFO: `/v3/users/a1a6b4b994b043f9af0ae355141faca2` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:02.918900 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c1a86-4e04-48f5-ae7f-e844ffa71d5a None admin] RBAC: Authorizing `identity:get_user(user_id=a1a6b4b994b043f9af0ae355141faca2)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:02.920387 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c1a86-4e04-48f5-ae7f-e844ffa71d5a None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:02.921988 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 79/154] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:02 2022] GET /identity/v3/users/a1a6b4b994b043f9af0ae355141faca2 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:02.923175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54f28-b333-4d04-a3ca-afc2054dd9f3 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:02.923456 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54f28-b333-4d04-a3ca-afc2054dd9f3 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:02.923727 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54f28-b333-4d04-a3ca-afc2054dd9f3 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:02.925055 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 80/155] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:02.931491 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e54f28-b333-4d04-a3ca-afc2054dd9f3 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:03.033295 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 76/156] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:03.035124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016791c0-7214-4b7e-9e2f-7388998f7a0a None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:03.035625 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016791c0-7214-4b7e-9e2f-7388998f7a0a None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:03.036157 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016791c0-7214-4b7e-9e2f-7388998f7a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:03.051982 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e54f28-b333-4d04-a3ca-afc2054dd9f3 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:03.069450 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-016791c0-7214-4b7e-9e2f-7388998f7a0a None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:03.073819 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-016791c0-7214-4b7e-9e2f-7388998f7a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:03.092754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cd2e0-4a29-4a9b-9354-5ef7db5350e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:03.098530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cd2e0-4a29-4a9b-9354-5ef7db5350e4 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:03.098530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cd2e0-4a29-4a9b-9354-5ef7db5350e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:03.098530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cd2e0-4a29-4a9b-9354-5ef7db5350e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:03.098961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:03.122745 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:03.167279 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cd2e0-4a29-4a9b-9354-5ef7db5350e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:03.169036 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cd2e0-4a29-4a9b-9354-5ef7db5350e4 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:03.205240 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 77/157] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:03.274170 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 81/158] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:03.280339 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016791c0-7214-4b7e-9e2f-7388998f7a0a None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:03.414691 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016791c0-7214-4b7e-9e2f-7388998f7a0a None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:03.451457 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51113c6a-1fca-4852-b6d6-ac4cd61e39ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:03.452102 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51113c6a-1fca-4852-b6d6-ac4cd61e39ad None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:03.452384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51113c6a-1fca-4852-b6d6-ac4cd61e39ad None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:03.452656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51113c6a-1fca-4852-b6d6-ac4cd61e39ad None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:03.453794 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51113c6a-1fca-4852-b6d6-ac4cd61e39ad None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:03.455266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51113c6a-1fca-4852-b6d6-ac4cd61e39ad None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:03.457243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 78/159] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:03 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:03.464361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cd2e0-4a29-4a9b-9354-5ef7db5350e4 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:03.530047 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:03.604316 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51113c6a-1fca-4852-b6d6-ac4cd61e39ad None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:03.607142 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cd2e0-4a29-4a9b-9354-5ef7db5350e4 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:03.646899 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fbbff-e455-422d-a894-fc2f641dc4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:03.647563 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fbbff-e455-422d-a894-fc2f641dc4e0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:03.647850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fbbff-e455-422d-a894-fc2f641dc4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:03.648126 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fbbff-e455-422d-a894-fc2f641dc4e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:03.648638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:03.648857 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fbbff-e455-422d-a894-fc2f641dc4e0 None admin] RBAC: Adding query filter params (role.id=807b71faee4a435e95e2ca3296e64c2e, scope.project.id=45e07b89720a4d87bfe2ca7a011f0871, user.id=a1a6b4b994b043f9af0ae355141faca2) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:03.649160 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fbbff-e455-422d-a894-fc2f641dc4e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:03.651715 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fbbff-e455-422d-a894-fc2f641dc4e0 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:03.658323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 82/160] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:03 2022] GET /identity/v3/role_assignments?user.id=a1a6b4b994b043f9af0ae355141faca2&scope.project.id=45e07b89720a4d87bfe2ca7a011f0871&role.id=807b71faee4a435e95e2ca3296e64c2e => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:03.730478 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51113c6a-1fca-4852-b6d6-ac4cd61e39ad None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:03.768484 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2741a-e762-44c6-8e46-55b1decee80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:03.769123 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2741a-e762-44c6-8e46-55b1decee80e None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:03.769401 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2741a-e762-44c6-8e46-55b1decee80e None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:03.769672 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2741a-e762-44c6-8e46-55b1decee80e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:03.782375 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2741a-e762-44c6-8e46-55b1decee80e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-91e2741a-e762-44c6-8e46-55b1decee80e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:03.787343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:03.788279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:03.789058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 79/161] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:53:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:03.797196 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fbbff-e455-422d-a894-fc2f641dc4e0 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:03.956304 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:03.963321 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fbbff-e455-422d-a894-fc2f641dc4e0 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:04.008218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557905c-f00a-4211-86c0-6e6da9e70fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:04.009289 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557905c-f00a-4211-86c0-6e6da9e70fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:04.009873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557905c-f00a-4211-86c0-6e6da9e70fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:04.009873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557905c-f00a-4211-86c0-6e6da9e70fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:04.010605 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557905c-f00a-4211-86c0-6e6da9e70fd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:04.011363 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557905c-f00a-4211-86c0-6e6da9e70fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:04.012782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557905c-f00a-4211-86c0-6e6da9e70fd1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:04.026855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 83/162] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:04.033069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2741a-e762-44c6-8e46-55b1decee80e None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:04.128718 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557905c-f00a-4211-86c0-6e6da9e70fd1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:04.165759 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:04.180094 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2741a-e762-44c6-8e46-55b1decee80e None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:04.238965 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79795c-7ef0-4b08-8948-8251a5fbfdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:04.239627 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79795c-7ef0-4b08-8948-8251a5fbfdc6 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:04.239910 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79795c-7ef0-4b08-8948-8251a5fbfdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:04.240185 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79795c-7ef0-4b08-8948-8251a5fbfdc6 None admin] PATH_INFO: `/v3/users/a1a6b4b994b043f9af0ae355141faca2` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:04.247191 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79795c-7ef0-4b08-8948-8251a5fbfdc6 None admin] RBAC: Authorizing `identity:get_user(user_id=a1a6b4b994b043f9af0ae355141faca2)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:04.248793 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79795c-7ef0-4b08-8948-8251a5fbfdc6 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:04.250861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 80/163] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:04 2022] GET /identity/v3/users/a1a6b4b994b043f9af0ae355141faca2 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:04.257983 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79795c-7ef0-4b08-8948-8251a5fbfdc6 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:04.390932 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557905c-f00a-4211-86c0-6e6da9e70fd1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:04.475416 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80802c11-4b49-4e55-a681-6e0c29c751a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:04.476065 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80802c11-4b49-4e55-a681-6e0c29c751a0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:04.476344 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80802c11-4b49-4e55-a681-6e0c29c751a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:04.476615 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80802c11-4b49-4e55-a681-6e0c29c751a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:04.485656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79795c-7ef0-4b08-8948-8251a5fbfdc6 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:04.500418 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80802c11-4b49-4e55-a681-6e0c29c751a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-80802c11-4b49-4e55-a681-6e0c29c751a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:04.507711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:04.509396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:04.510512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 84/164] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:53:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:04.513139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a82d5-0ac8-43bc-9c37-25a5b71e5817 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:04.513430 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a82d5-0ac8-43bc-9c37-25a5b71e5817 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:04.513736 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a82d5-0ac8-43bc-9c37-25a5b71e5817 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:04.517166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 85/165] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:04.517927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a82d5-0ac8-43bc-9c37-25a5b71e5817 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:04.562360 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ba3eb-9258-4a57-a040-94308030a7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:04.562989 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ba3eb-9258-4a57-a040-94308030a7c1 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:04.563268 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ba3eb-9258-4a57-a040-94308030a7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:04.563540 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ba3eb-9258-4a57-a040-94308030a7c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:04.568961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:04.635408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:04.745064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a82d5-0ac8-43bc-9c37-25a5b71e5817 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:04.745676 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ba3eb-9258-4a57-a040-94308030a7c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:04.746640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ba3eb-9258-4a57-a040-94308030a7c1 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:04.801859 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794d273-38cd-4163-b523-f579c2fbcfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:04.802653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794d273-38cd-4163-b523-f579c2fbcfaa None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:04.802939 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794d273-38cd-4163-b523-f579c2fbcfaa None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:04.803214 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794d273-38cd-4163-b523-f579c2fbcfaa None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:04.803884 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794d273-38cd-4163-b523-f579c2fbcfaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:04.804190 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794d273-38cd-4163-b523-f579c2fbcfaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:04.806130 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794d273-38cd-4163-b523-f579c2fbcfaa None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:04.815969 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 86/166] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:04.816933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7653d21-d74c-4965-96b4-520175fe48db None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:04.817215 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7653d21-d74c-4965-96b4-520175fe48db None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:04.817565 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7653d21-d74c-4965-96b4-520175fe48db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:04.836678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-c7653d21-d74c-4965-96b4-520175fe48db None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:04.838205 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-c7653d21-d74c-4965-96b4-520175fe48db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:04.952286 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 87/167] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:04.953265 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7653d21-d74c-4965-96b4-520175fe48db None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:04.974129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:04.985131 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 81/168] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 14:53:04.991055 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ba3eb-9258-4a57-a040-94308030a7c1 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:05.088181 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:05.109652 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7653d21-d74c-4965-96b4-520175fe48db None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:05.156295 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ba3eb-9258-4a57-a040-94308030a7c1 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:05.168975 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97365ede-1043-4c1d-a6e8-8a1721addfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:05.169634 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97365ede-1043-4c1d-a6e8-8a1721addfeb None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:05.169917 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97365ede-1043-4c1d-a6e8-8a1721addfeb None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:05.170186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97365ede-1043-4c1d-a6e8-8a1721addfeb None admin] PATH_INFO: `/v3/users/e7a12e84a7cb44eba823234391e6a002` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:05.171551 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97365ede-1043-4c1d-a6e8-8a1721addfeb None admin] RBAC: Authorizing `identity:get_user(user_id=e7a12e84a7cb44eba823234391e6a002)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:05.173107 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97365ede-1043-4c1d-a6e8-8a1721addfeb None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:05.174742 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 88/169] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:04 2022] GET /identity/v3/users/e7a12e84a7cb44eba823234391e6a002 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:05.180691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97365ede-1043-4c1d-a6e8-8a1721addfeb None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:05.219017 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6384f2-c14d-4132-8e73-a61264b43d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:05.219664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6384f2-c14d-4132-8e73-a61264b43d07 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:05.219938 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6384f2-c14d-4132-8e73-a61264b43d07 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:05.220206 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6384f2-c14d-4132-8e73-a61264b43d07 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:05.221386 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6384f2-c14d-4132-8e73-a61264b43d07 None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:05.222855 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6384f2-c14d-4132-8e73-a61264b43d07 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:05.224800 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 82/170] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:04 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:05.231493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6384f2-c14d-4132-8e73-a61264b43d07 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:05.306692 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:05.348788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97365ede-1043-4c1d-a6e8-8a1721addfeb None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:05.383295 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6384f2-c14d-4132-8e73-a61264b43d07 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:05.434067 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1ed98-5364-4460-8bdf-f4744cd12022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:05.434831 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:05.435401 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ed98-5364-4460-8bdf-f4744cd12022 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:05.435805 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ed98-5364-4460-8bdf-f4744cd12022 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:05.436701 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ed98-5364-4460-8bdf-f4744cd12022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:05.437129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d7c4d-584a-4951-bd8e-76497fb575fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:05.437741 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7c4d-584a-4951-bd8e-76497fb575fb None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:05.438026 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7c4d-584a-4951-bd8e-76497fb575fb None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:05.438317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7c4d-584a-4951-bd8e-76497fb575fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:05.439062 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d7c4d-584a-4951-bd8e-76497fb575fb None admin] RBAC: Adding query filter params (role.id=a3a5839e9bda47d8af7a7b707f7a9888, scope.project.id=45e07b89720a4d87bfe2ca7a011f0871, user.id=a1a6b4b994b043f9af0ae355141faca2) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:05.439373 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d7c4d-584a-4951-bd8e-76497fb575fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:05.440813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d7c4d-584a-4951-bd8e-76497fb575fb None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:05.459292 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 83/171] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:05 2022] GET /identity/v3/role_assignments?user.id=a1a6b4b994b043f9af0ae355141faca2&scope.project.id=45e07b89720a4d87bfe2ca7a011f0871&role.id=a3a5839e9bda47d8af7a7b707f7a9888 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:05.561925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1ed98-5364-4460-8bdf-f4744cd12022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:05.563456 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1ed98-5364-4460-8bdf-f4744cd12022 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:05.618647 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d7c4d-584a-4951-bd8e-76497fb575fb None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:05.700676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:05.747302 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 89/172] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 14:53:05.753411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1ed98-5364-4460-8bdf-f4744cd12022 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:05.797838 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d7c4d-584a-4951-bd8e-76497fb575fb None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:05.880237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecb8e0-cd3e-46cd-a3bf-6adb5fa94f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:05.881208 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecb8e0-cd3e-46cd-a3bf-6adb5fa94f2b None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:05.881748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecb8e0-cd3e-46cd-a3bf-6adb5fa94f2b None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:05.882036 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecb8e0-cd3e-46cd-a3bf-6adb5fa94f2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:05.902849 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecb8e0-cd3e-46cd-a3bf-6adb5fa94f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-66ecb8e0-cd3e-46cd-a3bf-6adb5fa94f2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:05.908811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:05.909753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:05.910659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 84/173] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:05.916907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecb8e0-cd3e-46cd-a3bf-6adb5fa94f2b None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:05.995730 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1ed98-5364-4460-8bdf-f4744cd12022 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:06.014672 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:06.085447 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9edfa1-6a7b-442f-96fb-f0e6278c74aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:06.086105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9edfa1-6a7b-442f-96fb-f0e6278c74aa None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.090519 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9edfa1-6a7b-442f-96fb-f0e6278c74aa None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.090886 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9edfa1-6a7b-442f-96fb-f0e6278c74aa None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.095179 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9edfa1-6a7b-442f-96fb-f0e6278c74aa None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:06.096706 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9edfa1-6a7b-442f-96fb-f0e6278c74aa None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:06.098715 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 90/174] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:05 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:06.106080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9edfa1-6a7b-442f-96fb-f0e6278c74aa None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:06.125809 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecb8e0-cd3e-46cd-a3bf-6adb5fa94f2b None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:06.202549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd030c-88e6-48cd-9c6a-a7b00a10c2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:06.203476 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd030c-88e6-48cd-9c6a-a7b00a10c2ee None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.203958 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd030c-88e6-48cd-9c6a-a7b00a10c2ee None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.204415 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd030c-88e6-48cd-9c6a-a7b00a10c2ee None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.205253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd030c-88e6-48cd-9c6a-a7b00a10c2ee None admin] RBAC: Adding query filter params (name=member) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:06.205731 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd030c-88e6-48cd-9c6a-a7b00a10c2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:06.213740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd030c-88e6-48cd-9c6a-a7b00a10c2ee None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:06.224294 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:06.236029 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 85/175] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:06.241163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd030c-88e6-48cd-9c6a-a7b00a10c2ee None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:06.315827 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9edfa1-6a7b-442f-96fb-f0e6278c74aa None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:06.373150 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1100c2f-ad11-47e6-bef3-3f56512010a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:06.374400 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1100c2f-ad11-47e6-bef3-3f56512010a3 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.374882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1100c2f-ad11-47e6-bef3-3f56512010a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.375580 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1100c2f-ad11-47e6-bef3-3f56512010a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.376951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1100c2f-ad11-47e6-bef3-3f56512010a3 None admin] RBAC: Adding query filter params (role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4, scope.project.id=45e07b89720a4d87bfe2ca7a011f0871, user.id=e7a12e84a7cb44eba823234391e6a002) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:06.377708 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1100c2f-ad11-47e6-bef3-3f56512010a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:06.380108 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1100c2f-ad11-47e6-bef3-3f56512010a3 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:06.388607 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 91/176] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:06 2022] GET /identity/v3/role_assignments?user.id=e7a12e84a7cb44eba823234391e6a002&scope.project.id=45e07b89720a4d87bfe2ca7a011f0871&role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:06.390809 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304c24c-348a-4ffa-ae5c-5f9453a4aafb None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.391540 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304c24c-348a-4ffa-ae5c-5f9453a4aafb None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.392023 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304c24c-348a-4ffa-ae5c-5f9453a4aafb None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.394674 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 92/177] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:06.396102 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd030c-88e6-48cd-9c6a-a7b00a10c2ee None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:06.396465 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4ec2d-eb14-42fd-bfa4-570ea8ae18db None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.397001 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4ec2d-eb14-42fd-bfa4-570ea8ae18db None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.397469 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4ec2d-eb14-42fd-bfa4-570ea8ae18db None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.401544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 93/178] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:06.403041 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997a61e-03cb-4eb1-918a-a316ac7fa67e None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.405465 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997a61e-03cb-4eb1-918a-a316ac7fa67e None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.405999 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997a61e-03cb-4eb1-918a-a316ac7fa67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.415576 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:06.436274 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-9997a61e-03cb-4eb1-918a-a316ac7fa67e None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:06.437600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-9997a61e-03cb-4eb1-918a-a316ac7fa67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:06.461744 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf68ba1-af21-4e26-a86b-5b102ec69b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:06.463789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68ba1-af21-4e26-a86b-5b102ec69b75 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.464599 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68ba1-af21-4e26-a86b-5b102ec69b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.465084 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68ba1-af21-4e26-a86b-5b102ec69b75 None admin] PATH_INFO: `/v3/users/a1a6b4b994b043f9af0ae355141faca2` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.467387 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf68ba1-af21-4e26-a86b-5b102ec69b75 None admin] RBAC: Authorizing `identity:get_user(user_id=a1a6b4b994b043f9af0ae355141faca2)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:06.469582 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf68ba1-af21-4e26-a86b-5b102ec69b75 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:06.472434 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 86/179] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:06 2022] GET /identity/v3/users/a1a6b4b994b043f9af0ae355141faca2 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:06.474252 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3917618-4caf-4d4d-aafe-f459c079ffae None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.474830 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3917618-4caf-4d4d-aafe-f459c079ffae None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.475303 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3917618-4caf-4d4d-aafe-f459c079ffae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.498914 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-f3917618-4caf-4d4d-aafe-f459c079ffae None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:06.500868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-f3917618-4caf-4d4d-aafe-f459c079ffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:06.551826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 94/180] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:06.553116 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997a61e-03cb-4eb1-918a-a316ac7fa67e None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:06.627247 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 87/181] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:06.629258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3179ab-531d-41d2-a51c-c39da02ce311 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.629750 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3179ab-531d-41d2-a51c-c39da02ce311 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.630225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3179ab-531d-41d2-a51c-c39da02ce311 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.630344 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:06.632441 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 88/182] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:06.635114 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4edbd-7bf8-470b-9646-c2d7493e031d None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.635942 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4edbd-7bf8-470b-9646-c2d7493e031d None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.636423 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4edbd-7bf8-470b-9646-c2d7493e031d None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.637885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 89/183] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:06.643618 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc718cc-ccd2-4bfe-8a71-99d10c43981f None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.657310 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc718cc-ccd2-4bfe-8a71-99d10c43981f None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.657310 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc718cc-ccd2-4bfe-8a71-99d10c43981f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.666800 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-3bc718cc-ccd2-4bfe-8a71-99d10c43981f None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:06.668246 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-3bc718cc-ccd2-4bfe-8a71-99d10c43981f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:06.695297 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997a61e-03cb-4eb1-918a-a316ac7fa67e None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:06.734478 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709e3e6-105a-47c7-af22-e23ae62f5c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:06.735141 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709e3e6-105a-47c7-af22-e23ae62f5c6a None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.735425 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709e3e6-105a-47c7-af22-e23ae62f5c6a None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.735697 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709e3e6-105a-47c7-af22-e23ae62f5c6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.754232 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 90/184] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:06.756037 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6df34-762e-457c-9041-38cec333c7c4 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:06.756879 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6df34-762e-457c-9041-38cec333c7c4 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:06.757333 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6df34-762e-457c-9041-38cec333c7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:06.789745 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-4ce6df34-762e-457c-9041-38cec333c7c4 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:06.792236 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-4ce6df34-762e-457c-9041-38cec333c7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:06.856200 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709e3e6-105a-47c7-af22-e23ae62f5c6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:06.856799 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:06.858092 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709e3e6-105a-47c7-af22-e23ae62f5c6a None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:06.931288 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 91/185] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:06.948818 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:06.989536 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6df34-762e-457c-9041-38cec333c7c4 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:07.043619 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 95/186] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:07.044478 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709e3e6-105a-47c7-af22-e23ae62f5c6a None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:07.134744 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6df34-762e-457c-9041-38cec333c7c4 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:07.160822 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709e3e6-105a-47c7-af22-e23ae62f5c6a None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:07.177434 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d5f6b-465c-44ad-88fc-45ffd74cb17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:07.178080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d5f6b-465c-44ad-88fc-45ffd74cb17b None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:07.178386 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d5f6b-465c-44ad-88fc-45ffd74cb17b None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:07.178662 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d5f6b-465c-44ad-88fc-45ffd74cb17b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:07.189743 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d5f6b-465c-44ad-88fc-45ffd74cb17b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-6e5d5f6b-465c-44ad-88fc-45ffd74cb17b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:07.196889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:07.197760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:07.198589 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 92/187] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:53:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:07.199242 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d5f6b-465c-44ad-88fc-45ffd74cb17b None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:07.201538 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77d87-d9ac-4cb6-a6bb-4aeece438c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:07.202171 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77d87-d9ac-4cb6-a6bb-4aeece438c3b None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:07.202484 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77d87-d9ac-4cb6-a6bb-4aeece438c3b None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:07.203006 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77d87-d9ac-4cb6-a6bb-4aeece438c3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:07.203955 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c77d87-d9ac-4cb6-a6bb-4aeece438c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:07.205424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c77d87-d9ac-4cb6-a6bb-4aeece438c3b None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:07.207028 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 96/188] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:07.207783 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77d87-d9ac-4cb6-a6bb-4aeece438c3b None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:07.225049 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:07.235928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:07.313226 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d5f6b-465c-44ad-88fc-45ffd74cb17b None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:07.313395 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77d87-d9ac-4cb6-a6bb-4aeece438c3b None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:07.347611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019ea2a-7fc0-4ff0-8140-bd9ed8b85990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:07.348237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019ea2a-7fc0-4ff0-8140-bd9ed8b85990 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:07.348521 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019ea2a-7fc0-4ff0-8140-bd9ed8b85990 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:07.348794 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019ea2a-7fc0-4ff0-8140-bd9ed8b85990 None admin] PATH_INFO: `/v3/projects/1adf18164de240399beabc64abe96f18` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:07.349139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ac6e4-205a-4e5e-be38-6b8a9e3d1b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:07.349760 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ac6e4-205a-4e5e-be38-6b8a9e3d1b48 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:07.349927 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019ea2a-7fc0-4ff0-8140-bd9ed8b85990 None admin] RBAC: Authorizing `identity:get_project(project_id=1adf18164de240399beabc64abe96f18)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:07.350020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ac6e4-205a-4e5e-be38-6b8a9e3d1b48 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:07.350314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ac6e4-205a-4e5e-be38-6b8a9e3d1b48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:07.351400 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019ea2a-7fc0-4ff0-8140-bd9ed8b85990 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:07.353500 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 93/189] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:07 2022] GET /identity/v3/projects/1adf18164de240399beabc64abe96f18 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:07.354073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019ea2a-7fc0-4ff0-8140-bd9ed8b85990 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:07.360635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ac6e4-205a-4e5e-be38-6b8a9e3d1b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-974ac6e4-205a-4e5e-be38-6b8a9e3d1b48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:07.365411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:07.366413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:07.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 97/190] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:53:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:07.368895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ac6e4-205a-4e5e-be38-6b8a9e3d1b48 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:07.438149 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:07.451826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:07.457340 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019ea2a-7fc0-4ff0-8140-bd9ed8b85990 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:07.467296 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ac6e4-205a-4e5e-be38-6b8a9e3d1b48 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:07.491708 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ac432-b65b-447a-ae80-ae6f549c5a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:07.492310 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ac432-b65b-447a-ae80-ae6f549c5a41 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:07.492591 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ac432-b65b-447a-ae80-ae6f549c5a41 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:07.493448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ac432-b65b-447a-ae80-ae6f549c5a41 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:07.494466 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ac432-b65b-447a-ae80-ae6f549c5a41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:07.494777 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ac432-b65b-447a-ae80-ae6f549c5a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:07.496166 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ac432-b65b-447a-ae80-ae6f549c5a41 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:07.502126 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba7a89-6143-4cfd-86d1-4d6cd31280aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:07.502756 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba7a89-6143-4cfd-86d1-4d6cd31280aa None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:07.503035 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba7a89-6143-4cfd-86d1-4d6cd31280aa None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:07.503304 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba7a89-6143-4cfd-86d1-4d6cd31280aa None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:07.503946 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba7a89-6143-4cfd-86d1-4d6cd31280aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:07.504036 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 94/191] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:07.509620 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ac432-b65b-447a-ae80-ae6f549c5a41 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:07.509704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba7a89-6143-4cfd-86d1-4d6cd31280aa None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:07.605552 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ac432-b65b-447a-ae80-ae6f549c5a41 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:07.605837 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 98/192] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 31 14:53:07 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:53:07.606970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba7a89-6143-4cfd-86d1-4d6cd31280aa None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:07.657816 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f858f1-dd3f-4feb-8ef9-6ca3f39f54f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:07.658873 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f858f1-dd3f-4feb-8ef9-6ca3f39f54f4 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:07.659328 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f858f1-dd3f-4feb-8ef9-6ca3f39f54f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:07.660002 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f858f1-dd3f-4feb-8ef9-6ca3f39f54f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:07.677093 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f858f1-dd3f-4feb-8ef9-6ca3f39f54f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-10f858f1-dd3f-4feb-8ef9-6ca3f39f54f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:07.682924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:07.683880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:07.684645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 95/193] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:07.685295 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f858f1-dd3f-4feb-8ef9-6ca3f39f54f4 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:07.711091 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:07.728037 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba7a89-6143-4cfd-86d1-4d6cd31280aa None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:07.759752 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:07.769496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb781a-d787-402d-b748-e0d86f9c36a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:07.771123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb781a-d787-402d-b748-e0d86f9c36a7 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:07.771403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb781a-d787-402d-b748-e0d86f9c36a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:07.771672 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb781a-d787-402d-b748-e0d86f9c36a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:07.772404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb781a-d787-402d-b748-e0d86f9c36a7 None admin] RBAC: Adding query filter params (role.id=807b71faee4a435e95e2ca3296e64c2e, scope.project.id=1adf18164de240399beabc64abe96f18, user.id=a1a6b4b994b043f9af0ae355141faca2) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:07.772719 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb781a-d787-402d-b748-e0d86f9c36a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:07.774954 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb781a-d787-402d-b748-e0d86f9c36a7 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:07.782443 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 99/194] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:07 2022] GET /identity/v3/role_assignments?user.id=a1a6b4b994b043f9af0ae355141faca2&scope.project.id=1adf18164de240399beabc64abe96f18&role.id=807b71faee4a435e95e2ca3296e64c2e => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:07.782443 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb781a-d787-402d-b748-e0d86f9c36a7 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:07.816184 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f858f1-dd3f-4feb-8ef9-6ca3f39f54f4 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:07.874344 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293f68f-1f67-4437-a6a0-52035b81fb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:07.874946 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293f68f-1f67-4437-a6a0-52035b81fb18 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:07.875295 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293f68f-1f67-4437-a6a0-52035b81fb18 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:07.875569 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293f68f-1f67-4437-a6a0-52035b81fb18 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:07.876250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293f68f-1f67-4437-a6a0-52035b81fb18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:07.876553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293f68f-1f67-4437-a6a0-52035b81fb18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:07.877964 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293f68f-1f67-4437-a6a0-52035b81fb18 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:07.892478 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 96/195] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:07.893349 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293f68f-1f67-4437-a6a0-52035b81fb18 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:07.948487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb781a-d787-402d-b748-e0d86f9c36a7 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:07.992007 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5556b06-96c8-4f0a-89c4-f1135771920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:07.992680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5556b06-96c8-4f0a-89c4-f1135771920e None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:07.993491 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5556b06-96c8-4f0a-89c4-f1135771920e None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:07.993836 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5556b06-96c8-4f0a-89c4-f1135771920e None admin] PATH_INFO: `/v3/users/ecc7c3ce6e3b4cd89872a0acaec9c355` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:08.040953 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5556b06-96c8-4f0a-89c4-f1135771920e None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c3ce6e3b4cd89872a0acaec9c355)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:08.042620 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:08.042781 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5556b06-96c8-4f0a-89c4-f1135771920e None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:08.045274 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 100/196] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:07 2022] GET /identity/v3/users/ecc7c3ce6e3b4cd89872a0acaec9c355 => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:08.045895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5556b06-96c8-4f0a-89c4-f1135771920e None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:08.065434 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293f68f-1f67-4437-a6a0-52035b81fb18 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:08.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12fc60-0756-479d-a17c-b6824cebed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:08.106744 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12fc60-0756-479d-a17c-b6824cebed87 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:08.107026 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12fc60-0756-479d-a17c-b6824cebed87 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:08.107300 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12fc60-0756-479d-a17c-b6824cebed87 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:08.108236 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12fc60-0756-479d-a17c-b6824cebed87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:08.108532 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12fc60-0756-479d-a17c-b6824cebed87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:08.110046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12fc60-0756-479d-a17c-b6824cebed87 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:08.110817 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:08.120720 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 97/197] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:08.121644 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12fc60-0756-479d-a17c-b6824cebed87 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:08.174797 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5556b06-96c8-4f0a-89c4-f1135771920e None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:08.213751 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637d5f1-2dc7-4e30-98ae-f0b810ea04fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:08.214481 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637d5f1-2dc7-4e30-98ae-f0b810ea04fd None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:08.214762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637d5f1-2dc7-4e30-98ae-f0b810ea04fd None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:08.215034 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637d5f1-2dc7-4e30-98ae-f0b810ea04fd None admin] PATH_INFO: `/v3/users/ecc7c3ce6e3b4cd89872a0acaec9c355` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:08.216273 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637d5f1-2dc7-4e30-98ae-f0b810ea04fd None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c3ce6e3b4cd89872a0acaec9c355)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:08.217783 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637d5f1-2dc7-4e30-98ae-f0b810ea04fd None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:08.219706 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 101/198] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:08 2022] GET /identity/v3/users/ecc7c3ce6e3b4cd89872a0acaec9c355 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:08.220295 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637d5f1-2dc7-4e30-98ae-f0b810ea04fd None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:08.270253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12fc60-0756-479d-a17c-b6824cebed87 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:08.319469 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e23e8-993b-4634-90ee-ca7025bfebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:08.320404 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e23e8-993b-4634-90ee-ca7025bfebbc None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:08.320692 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e23e8-993b-4634-90ee-ca7025bfebbc None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:08.321483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e23e8-993b-4634-90ee-ca7025bfebbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:08.336542 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:08.366418 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637d5f1-2dc7-4e30-98ae-f0b810ea04fd None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:08.390073 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:08.412749 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e23e8-993b-4634-90ee-ca7025bfebbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:08.414013 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c11e0-825a-4556-89b1-dc011dfc4e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:08.415724 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e23e8-993b-4634-90ee-ca7025bfebbc None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:08.416458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c11e0-825a-4556-89b1-dc011dfc4e96 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:08.416757 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c11e0-825a-4556-89b1-dc011dfc4e96 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:08.417032 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c11e0-825a-4556-89b1-dc011dfc4e96 None admin] PATH_INFO: `/v3/users/ca985085e4c6488da8e47ceb10d2b930` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:08.418221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c11e0-825a-4556-89b1-dc011dfc4e96 None admin] RBAC: Authorizing `identity:get_user(user_id=ca985085e4c6488da8e47ceb10d2b930)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:08.420778 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c11e0-825a-4556-89b1-dc011dfc4e96 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:08.422428 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 102/199] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:08 2022] GET /identity/v3/users/ca985085e4c6488da8e47ceb10d2b930 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:08.424633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c11e0-825a-4556-89b1-dc011dfc4e96 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:08.586906 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 98/200] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:08.587654 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e23e8-993b-4634-90ee-ca7025bfebbc None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:08.596841 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c11e0-825a-4556-89b1-dc011dfc4e96 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:08.634823 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:08.648404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d43ff-5fec-4075-97ce-e41265f91f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:08.650577 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d43ff-5fec-4075-97ce-e41265f91f08 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:08.651224 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d43ff-5fec-4075-97ce-e41265f91f08 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:08.652009 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d43ff-5fec-4075-97ce-e41265f91f08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:08.705340 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e23e8-993b-4634-90ee-ca7025bfebbc None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:08.724882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:08.740502 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d43ff-5fec-4075-97ce-e41265f91f08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:08.742263 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d43ff-5fec-4075-97ce-e41265f91f08 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:08.745678 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26060ec5-99da-463e-a308-203336ee14fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:08.745678 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060ec5-99da-463e-a308-203336ee14fc None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:08.746007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060ec5-99da-463e-a308-203336ee14fc None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:08.746236 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060ec5-99da-463e-a308-203336ee14fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:08.820496 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26060ec5-99da-463e-a308-203336ee14fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:08.822530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26060ec5-99da-463e-a308-203336ee14fc None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:08.857433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 103/201] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:08.858923 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d43ff-5fec-4075-97ce-e41265f91f08 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:08.877449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:08.959769 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 99/202] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:08.960954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26060ec5-99da-463e-a308-203336ee14fc None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:08.967705 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:08.984375 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d43ff-5fec-4075-97ce-e41265f91f08 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:09.026048 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a111da-be41-4c52-ba52-fcc706c24d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:09.026877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a111da-be41-4c52-ba52-fcc706c24d08 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:09.027173 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a111da-be41-4c52-ba52-fcc706c24d08 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:09.027445 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a111da-be41-4c52-ba52-fcc706c24d08 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:09.028760 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a111da-be41-4c52-ba52-fcc706c24d08 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:09.030246 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a111da-be41-4c52-ba52-fcc706c24d08 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:09.032074 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 104/203] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:08 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:09.032873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a111da-be41-4c52-ba52-fcc706c24d08 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:09.128463 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26060ec5-99da-463e-a308-203336ee14fc None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:09.165554 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ac090-bcd8-4e4a-98be-9a45855a8c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:09.166200 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a111da-be41-4c52-ba52-fcc706c24d08 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:09.166341 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ac090-bcd8-4e4a-98be-9a45855a8c13 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:09.166583 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ac090-bcd8-4e4a-98be-9a45855a8c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:09.166860 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ac090-bcd8-4e4a-98be-9a45855a8c13 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:09.168098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ac090-bcd8-4e4a-98be-9a45855a8c13 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:09.170279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ac090-bcd8-4e4a-98be-9a45855a8c13 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:09.171277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 100/204] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:08 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:09.176468 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ac090-bcd8-4e4a-98be-9a45855a8c13 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:09.191898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:09.210277 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb672-de2e-45fc-87ae-744b545dfba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:09.211207 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb672-de2e-45fc-87ae-744b545dfba4 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:09.212282 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb672-de2e-45fc-87ae-744b545dfba4 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:09.212743 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb672-de2e-45fc-87ae-744b545dfba4 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:09.214111 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eeb672-de2e-45fc-87ae-744b545dfba4 None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:09.215773 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eeb672-de2e-45fc-87ae-744b545dfba4 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:09.217731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 105/205] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:09 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:09.223205 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb672-de2e-45fc-87ae-744b545dfba4 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:09.254126 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:09.292882 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ac090-bcd8-4e4a-98be-9a45855a8c13 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:09.332343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356cd2a-5b0a-4156-bae1-9b7792228ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:09.333304 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356cd2a-5b0a-4156-bae1-9b7792228ea8 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:09.333786 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356cd2a-5b0a-4156-bae1-9b7792228ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:09.334273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356cd2a-5b0a-4156-bae1-9b7792228ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:09.335277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356cd2a-5b0a-4156-bae1-9b7792228ea8 None admin] RBAC: Adding query filter params (role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4, scope.project.id=a37fe08aba474a1bb58912f977979b86, user.id=ecc7c3ce6e3b4cd89872a0acaec9c355) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:09.335788 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356cd2a-5b0a-4156-bae1-9b7792228ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:09.338419 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356cd2a-5b0a-4156-bae1-9b7792228ea8 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:09.344787 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 101/206] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:09 2022] GET /identity/v3/role_assignments?user.id=ecc7c3ce6e3b4cd89872a0acaec9c355&scope.project.id=a37fe08aba474a1bb58912f977979b86&role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:09.345899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356cd2a-5b0a-4156-bae1-9b7792228ea8 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:09.358108 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb672-de2e-45fc-87ae-744b545dfba4 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:09.398228 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ba2c3-bda5-44b9-9125-06c41570cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:09.399079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ba2c3-bda5-44b9-9125-06c41570cb9d None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:09.399988 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ba2c3-bda5-44b9-9125-06c41570cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:09.400424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ba2c3-bda5-44b9-9125-06c41570cb9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:09.401869 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ba2c3-bda5-44b9-9125-06c41570cb9d None admin] RBAC: Adding query filter params (role.id=a3a5839e9bda47d8af7a7b707f7a9888, scope.project.id=a37fe08aba474a1bb58912f977979b86, user.id=ecc7c3ce6e3b4cd89872a0acaec9c355) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:09.402340 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ba2c3-bda5-44b9-9125-06c41570cb9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:09.404390 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ba2c3-bda5-44b9-9125-06c41570cb9d None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:09.411366 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 106/207] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:09 2022] GET /identity/v3/role_assignments?user.id=ecc7c3ce6e3b4cd89872a0acaec9c355&scope.project.id=a37fe08aba474a1bb58912f977979b86&role.id=a3a5839e9bda47d8af7a7b707f7a9888 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:09.505101 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:09.532896 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356cd2a-5b0a-4156-bae1-9b7792228ea8 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:09.571868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993bdd1-ae91-451a-a08d-71102ad0f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:09.572507 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993bdd1-ae91-451a-a08d-71102ad0f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:09.572791 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993bdd1-ae91-451a-a08d-71102ad0f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:09.573068 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993bdd1-ae91-451a-a08d-71102ad0f4a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:09.573815 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993bdd1-ae91-451a-a08d-71102ad0f4a0 None admin] RBAC: Adding query filter params (role.id=6e5c958fa3a9494db4490551ae5253a9, scope.project.id=45e07b89720a4d87bfe2ca7a011f0871, user.id=ca985085e4c6488da8e47ceb10d2b930) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:09.574130 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993bdd1-ae91-451a-a08d-71102ad0f4a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:09.579171 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993bdd1-ae91-451a-a08d-71102ad0f4a0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:09.582879 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 102/208] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:09 2022] GET /identity/v3/role_assignments?user.id=ca985085e4c6488da8e47ceb10d2b930&scope.project.id=45e07b89720a4d87bfe2ca7a011f0871&role.id=6e5c958fa3a9494db4490551ae5253a9 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:10.242370 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3eb70-1829-4525-89f8-0735e886816c None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:10.243418 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3eb70-1829-4525-89f8-0735e886816c None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:10.243639 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3eb70-1829-4525-89f8-0735e886816c None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:10.245376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 107/209] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:10.250548 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237248-6df0-4bb0-85e2-ce1b94b8d429 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:10.250963 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237248-6df0-4bb0-85e2-ce1b94b8d429 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:10.251104 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237248-6df0-4bb0-85e2-ce1b94b8d429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:10.255188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89772c-29ff-44cd-b1dd-43072acc135c None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:10.255584 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89772c-29ff-44cd-b1dd-43072acc135c None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:10.255864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89772c-29ff-44cd-b1dd-43072acc135c None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:10.257355 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 108/210] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:10.263039 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe840-73dd-42ba-b5e8-6d53974b2614 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:10.263328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe840-73dd-42ba-b5e8-6d53974b2614 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:10.263606 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe840-73dd-42ba-b5e8-6d53974b2614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:10.272847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-ca237248-6df0-4bb0-85e2-ce1b94b8d429 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:10.274167 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-ca237248-6df0-4bb0-85e2-ce1b94b8d429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:10.281990 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-f0cfe840-73dd-42ba-b5e8-6d53974b2614 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:10.283208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-f0cfe840-73dd-42ba-b5e8-6d53974b2614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:10.361211 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 109/211] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:10.361802 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 103/212] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:10.696837 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfe840-73dd-42ba-b5e8-6d53974b2614 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:10.711234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca237248-6df0-4bb0-85e2-ce1b94b8d429 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:10.717636 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:10.790474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:10.826485 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfe840-73dd-42ba-b5e8-6d53974b2614 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:10.829112 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca237248-6df0-4bb0-85e2-ce1b94b8d429 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:10.867007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf123ee5-b6c7-4981-912a-f479e158b3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:10.867652 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf123ee5-b6c7-4981-912a-f479e158b3fb None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:10.868193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf123ee5-b6c7-4981-912a-f479e158b3fb None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:10.868474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf123ee5-b6c7-4981-912a-f479e158b3fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:10.869837 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf123ee5-b6c7-4981-912a-f479e158b3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:10.871392 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf123ee5-b6c7-4981-912a-f479e158b3fb None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:10.871913 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f06686-78e2-4f34-b1df-0ed3b1b8c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:10.872863 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f06686-78e2-4f34-b1df-0ed3b1b8c320 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:10.877641 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 104/213] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:10.878043 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f06686-78e2-4f34-b1df-0ed3b1b8c320 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:10.882424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f06686-78e2-4f34-b1df-0ed3b1b8c320 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:10.882525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf123ee5-b6c7-4981-912a-f479e158b3fb None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:10.891141 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f06686-78e2-4f34-b1df-0ed3b1b8c320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-49f06686-78e2-4f34-b1df-0ed3b1b8c320 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:10.899588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:10.900534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:10.901334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 110/214] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:10.905098 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f06686-78e2-4f34-b1df-0ed3b1b8c320 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:10.993503 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:10.999465 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf123ee5-b6c7-4981-912a-f479e158b3fb None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:11.018576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f06686-78e2-4f34-b1df-0ed3b1b8c320 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:11.037559 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc54628-e07a-4bcb-8f32-ac67117a00f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:11.038556 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc54628-e07a-4bcb-8f32-ac67117a00f9 None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:11.039129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc54628-e07a-4bcb-8f32-ac67117a00f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:11.040114 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc54628-e07a-4bcb-8f32-ac67117a00f9 None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:11.040960 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc54628-e07a-4bcb-8f32-ac67117a00f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:11.042592 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc54628-e07a-4bcb-8f32-ac67117a00f9 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:11.052724 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:11.059551 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81b00b-13f8-4628-a67c-d76a04f56963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:11.063482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81b00b-13f8-4628-a67c-d76a04f56963 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:11.063482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81b00b-13f8-4628-a67c-d76a04f56963 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:11.063482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81b00b-13f8-4628-a67c-d76a04f56963 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:11.063482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81b00b-13f8-4628-a67c-d76a04f56963 None admin] RBAC: Adding query filter params (name=member) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:11.063482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81b00b-13f8-4628-a67c-d76a04f56963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:11.063482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81b00b-13f8-4628-a67c-d76a04f56963 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:11.073879 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 111/215] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:11.079763 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81b00b-13f8-4628-a67c-d76a04f56963 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:11.140350 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 105/216] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 31 14:53:10 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 14:53:11.194503 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81b00b-13f8-4628-a67c-d76a04f56963 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:11.234533 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4555b9b-541b-4c0b-b872-ef5be1bc2bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:11.235429 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555b9b-541b-4c0b-b872-ef5be1bc2bf3 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:11.235862 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555b9b-541b-4c0b-b872-ef5be1bc2bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:11.236300 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555b9b-541b-4c0b-b872-ef5be1bc2bf3 None admin] PATH_INFO: `/v3/users/517f0dbe164e41aca19e6930fb3f4773` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:11.246781 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:11.255106 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4555b9b-541b-4c0b-b872-ef5be1bc2bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=517f0dbe164e41aca19e6930fb3f4773)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:11.256636 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4555b9b-541b-4c0b-b872-ef5be1bc2bf3 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:11.259379 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 112/217] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:11 2022] GET /identity/v3/users/517f0dbe164e41aca19e6930fb3f4773 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:11.265107 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc54628-e07a-4bcb-8f32-ac67117a00f9 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:11.381050 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc54628-e07a-4bcb-8f32-ac67117a00f9 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:11.416972 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce8e9f-6a37-4a6d-a489-094ff9937296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:11.417602 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce8e9f-6a37-4a6d-a489-094ff9937296 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:11.417885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce8e9f-6a37-4a6d-a489-094ff9937296 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:11.418161 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce8e9f-6a37-4a6d-a489-094ff9937296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:11.482302 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:11.494517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce8e9f-6a37-4a6d-a489-094ff9937296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:11.495996 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce8e9f-6a37-4a6d-a489-094ff9937296 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:11.612159 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 106/218] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:11.618674 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4555b9b-541b-4c0b-b872-ef5be1bc2bf3 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:11.715622 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f87b0b-d74f-4511-8353-ac1acea5e801 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:11.716274 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f87b0b-d74f-4511-8353-ac1acea5e801 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:11.716752 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f87b0b-d74f-4511-8353-ac1acea5e801 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:11.719024 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 107/219] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:11.728272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3775e-b7b0-43ae-a401-83bede0fe5c9 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:11.728852 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3775e-b7b0-43ae-a401-83bede0fe5c9 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:11.729354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3775e-b7b0-43ae-a401-83bede0fe5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:11.753544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4555b9b-541b-4c0b-b872-ef5be1bc2bf3 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:11.775625 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-33d3775e-b7b0-43ae-a401-83bede0fe5c9 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:11.777170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-33d3775e-b7b0-43ae-a401-83bede0fe5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:11.801078 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8702e2-3b88-4e69-a03c-d924d1e49de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:11.802110 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8702e2-3b88-4e69-a03c-d924d1e49de6 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:11.803613 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8702e2-3b88-4e69-a03c-d924d1e49de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:11.804632 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8702e2-3b88-4e69-a03c-d924d1e49de6 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:11.807486 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8702e2-3b88-4e69-a03c-d924d1e49de6 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:11.809785 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8702e2-3b88-4e69-a03c-d924d1e49de6 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:11.815403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 113/220] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:11 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:11.822058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8702e2-3b88-4e69-a03c-d924d1e49de6 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:11.925416 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 108/221] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:11.926730 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ad838-3aa7-4aa2-a294-7e6859e7c2c8 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:11.927020 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ad838-3aa7-4aa2-a294-7e6859e7c2c8 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:11.927300 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ad838-3aa7-4aa2-a294-7e6859e7c2c8 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:11.928685 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 109/222] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:11.934816 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc09a17-da88-4ffb-93fc-5bd1a07bb87f None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:11.935135 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc09a17-da88-4ffb-93fc-5bd1a07bb87f None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:11.935447 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc09a17-da88-4ffb-93fc-5bd1a07bb87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:11.940182 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:11.955955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-9cc09a17-da88-4ffb-93fc-5bd1a07bb87f None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:11.962436 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-9cc09a17-da88-4ffb-93fc-5bd1a07bb87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:12.002761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:12.016160 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8702e2-3b88-4e69-a03c-d924d1e49de6 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:12.092959 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a4bb-7966-4c66-89ce-43ab6bd38a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:12.092959 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a4bb-7966-4c66-89ce-43ab6bd38a64 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:12.093251 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 110/223] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:12.093326 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a4bb-7966-4c66-89ce-43ab6bd38a64 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:12.093326 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a4bb-7966-4c66-89ce-43ab6bd38a64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:12.093326 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122a4bb-7966-4c66-89ce-43ab6bd38a64 None admin] RBAC: Adding query filter params (role.id=807b71faee4a435e95e2ca3296e64c2e, scope.project.id=a37fe08aba474a1bb58912f977979b86, user.id=517f0dbe164e41aca19e6930fb3f4773) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:12.094209 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122a4bb-7966-4c66-89ce-43ab6bd38a64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:12.101690 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122a4bb-7966-4c66-89ce-43ab6bd38a64 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:12.113030 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 114/224] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:11 2022] GET /identity/v3/role_assignments?user.id=517f0dbe164e41aca19e6930fb3f4773&scope.project.id=a37fe08aba474a1bb58912f977979b86&role.id=807b71faee4a435e95e2ca3296e64c2e => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:12.289166 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc09a17-da88-4ffb-93fc-5bd1a07bb87f None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:12.427342 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc09a17-da88-4ffb-93fc-5bd1a07bb87f None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:12.478762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6300f33-1eef-4292-a855-ac6d29aa0563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:12.479410 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300f33-1eef-4292-a855-ac6d29aa0563 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:12.479692 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300f33-1eef-4292-a855-ac6d29aa0563 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:12.479967 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300f33-1eef-4292-a855-ac6d29aa0563 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:12.495104 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6300f33-1eef-4292-a855-ac6d29aa0563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:12.499274 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a4bb-7966-4c66-89ce-43ab6bd38a64 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-b6300f33-1eef-4292-a855-ac6d29aa0563 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:12.500116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:12.500981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:12.501768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 111/225] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:53:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:12.509268 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6300f33-1eef-4292-a855-ac6d29aa0563 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:12.537057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:12.623872 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a4bb-7966-4c66-89ce-43ab6bd38a64 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:12.655882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:12.666752 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee3a89-9c4c-4a45-99b1-44a5aca7d119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:12.667405 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3a89-9c4c-4a45-99b1-44a5aca7d119 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:12.668440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3a89-9c4c-4a45-99b1-44a5aca7d119 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:12.668440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3a89-9c4c-4a45-99b1-44a5aca7d119 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:12.681157 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee3a89-9c4c-4a45-99b1-44a5aca7d119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-b8ee3a89-9c4c-4a45-99b1-44a5aca7d119 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:12.687361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:12.689515 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:12.691583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 115/226] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:53:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:12.698388 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee3a89-9c4c-4a45-99b1-44a5aca7d119 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:12.768439 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6300f33-1eef-4292-a855-ac6d29aa0563 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:12.817169 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee3a89-9c4c-4a45-99b1-44a5aca7d119 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:12.869543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e498bb-8a8e-4d28-8c32-eeb29c83b03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:12.870163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e498bb-8a8e-4d28-8c32-eeb29c83b03b None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:12.870489 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e498bb-8a8e-4d28-8c32-eeb29c83b03b None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:12.870874 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e498bb-8a8e-4d28-8c32-eeb29c83b03b None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:12.871544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e498bb-8a8e-4d28-8c32-eeb29c83b03b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:12.871854 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e498bb-8a8e-4d28-8c32-eeb29c83b03b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:12.873240 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e498bb-8a8e-4d28-8c32-eeb29c83b03b None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:12.875604 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce6d9c-af5a-47b5-b0f8-adc1321112e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:12.876173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce6d9c-af5a-47b5-b0f8-adc1321112e2 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:12.876454 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce6d9c-af5a-47b5-b0f8-adc1321112e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:12.876729 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce6d9c-af5a-47b5-b0f8-adc1321112e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:12.877463 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce6d9c-af5a-47b5-b0f8-adc1321112e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:12.877770 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce6d9c-af5a-47b5-b0f8-adc1321112e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:12.879180 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce6d9c-af5a-47b5-b0f8-adc1321112e2 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:12.882194 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 116/227] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:12.888952 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e498bb-8a8e-4d28-8c32-eeb29c83b03b None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:12.902488 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 112/228] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:12.908118 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce6d9c-af5a-47b5-b0f8-adc1321112e2 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:12.948790 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:13.011259 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e498bb-8a8e-4d28-8c32-eeb29c83b03b None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:13.077962 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e5a50-5682-46cb-81c4-287dcf973fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:13.078636 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e5a50-5682-46cb-81c4-287dcf973fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:13.078918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e5a50-5682-46cb-81c4-287dcf973fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:13.079195 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e5a50-5682-46cb-81c4-287dcf973fd1 None admin] PATH_INFO: `/v3/users/ecc7c3ce6e3b4cd89872a0acaec9c355` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:13.080350 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e5a50-5682-46cb-81c4-287dcf973fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c3ce6e3b4cd89872a0acaec9c355)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:13.081325 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:13.085228 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e5a50-5682-46cb-81c4-287dcf973fd1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:13.088704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 117/229] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:12 2022] GET /identity/v3/users/ecc7c3ce6e3b4cd89872a0acaec9c355 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:13.110789 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e5a50-5682-46cb-81c4-287dcf973fd1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:13.128164 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce6d9c-af5a-47b5-b0f8-adc1321112e2 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:13.185550 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab3fd4-026c-4e09-8f20-b52ed4fb76be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:13.186243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab3fd4-026c-4e09-8f20-b52ed4fb76be None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:13.186558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab3fd4-026c-4e09-8f20-b52ed4fb76be None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:13.186839 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab3fd4-026c-4e09-8f20-b52ed4fb76be None admin] PATH_INFO: `/v3/users/ecc7c3ce6e3b4cd89872a0acaec9c355` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:13.189141 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab3fd4-026c-4e09-8f20-b52ed4fb76be None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c3ce6e3b4cd89872a0acaec9c355)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:13.190705 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab3fd4-026c-4e09-8f20-b52ed4fb76be None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:13.192467 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 113/230] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:12 2022] GET /identity/v3/users/ecc7c3ce6e3b4cd89872a0acaec9c355 => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:13.208967 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab3fd4-026c-4e09-8f20-b52ed4fb76be None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:13.242925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e5a50-5682-46cb-81c4-287dcf973fd1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:13.260334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:13.280597 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599b6c7-0ae0-4121-a9cc-1bbf11bd95c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:13.281224 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599b6c7-0ae0-4121-a9cc-1bbf11bd95c3 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:13.281500 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599b6c7-0ae0-4121-a9cc-1bbf11bd95c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:13.281764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599b6c7-0ae0-4121-a9cc-1bbf11bd95c3 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:13.283728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599b6c7-0ae0-4121-a9cc-1bbf11bd95c3 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:13.285059 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599b6c7-0ae0-4121-a9cc-1bbf11bd95c3 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:13.292158 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 118/231] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:13 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:13.294033 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599b6c7-0ae0-4121-a9cc-1bbf11bd95c3 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:13.406910 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab3fd4-026c-4e09-8f20-b52ed4fb76be None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:13.469489 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41846e6f-54ac-405c-b77b-cfd1122e8739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:13.470121 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41846e6f-54ac-405c-b77b-cfd1122e8739 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:13.470472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41846e6f-54ac-405c-b77b-cfd1122e8739 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:13.470749 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41846e6f-54ac-405c-b77b-cfd1122e8739 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:13.472047 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41846e6f-54ac-405c-b77b-cfd1122e8739 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:13.473485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41846e6f-54ac-405c-b77b-cfd1122e8739 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:13.475313 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 114/232] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:13 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:13.490741 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599b6c7-0ae0-4121-a9cc-1bbf11bd95c3 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:13.500201 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41846e6f-54ac-405c-b77b-cfd1122e8739 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:13.516434 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:13.567959 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387de171-786b-4865-9e6b-9683aa8d57aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:13.569209 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387de171-786b-4865-9e6b-9683aa8d57aa None admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:13.569734 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387de171-786b-4865-9e6b-9683aa8d57aa None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:13.570156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387de171-786b-4865-9e6b-9683aa8d57aa None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86/users/ecc7c3ce6e3b4cd89872a0acaec9c355/roles/a3a5839e9bda47d8af7a7b707f7a9888` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:13.573151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387de171-786b-4865-9e6b-9683aa8d57aa None admin] RBAC: Authorizing `identity:create_grant(project_id=a37fe08aba474a1bb58912f977979b86, user_id=ecc7c3ce6e3b4cd89872a0acaec9c355, role_id=a3a5839e9bda47d8af7a7b707f7a9888)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:13.577249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387de171-786b-4865-9e6b-9683aa8d57aa None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:13.652155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 119/233] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:53:13 2022] PUT /identity/v3/projects/a37fe08aba474a1bb58912f977979b86/users/ecc7c3ce6e3b4cd89872a0acaec9c355/roles/a3a5839e9bda47d8af7a7b707f7a9888 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:53:13.656343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41846e6f-54ac-405c-b77b-cfd1122e8739 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:13.714882 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9269a9-d911-4d0a-9f2b-c9364eb55c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:13.715485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9269a9-d911-4d0a-9f2b-c9364eb55c20 None admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:13.715766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9269a9-d911-4d0a-9f2b-c9364eb55c20 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:13.716037 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9269a9-d911-4d0a-9f2b-c9364eb55c20 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86/users/ecc7c3ce6e3b4cd89872a0acaec9c355/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:13.718171 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9269a9-d911-4d0a-9f2b-c9364eb55c20 None admin] RBAC: Authorizing `identity:create_grant(project_id=a37fe08aba474a1bb58912f977979b86, user_id=ecc7c3ce6e3b4cd89872a0acaec9c355, role_id=7fe1d0d9f098408c9dc7ed9fca08a4a4)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:13.719760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9269a9-d911-4d0a-9f2b-c9364eb55c20 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:13.817422 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 115/234] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:53:13 2022] PUT /identity/v3/projects/a37fe08aba474a1bb58912f977979b86/users/ecc7c3ce6e3b4cd89872a0acaec9c355/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:53:13.900249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea9f75-20f6-4309-8585-a95ec3a568b9 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:13.900907 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea9f75-20f6-4309-8585-a95ec3a568b9 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:13.901367 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea9f75-20f6-4309-8585-a95ec3a568b9 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:13.903331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 120/235] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:13.909447 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafcf54-ac95-4221-b96e-a41c480336fd None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:13.909775 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafcf54-ac95-4221-b96e-a41c480336fd None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:13.910106 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafcf54-ac95-4221-b96e-a41c480336fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:13.932732 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-9eafcf54-ac95-4221-b96e-a41c480336fd None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:13.933939 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-9eafcf54-ac95-4221-b96e-a41c480336fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:14.014982 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:14.025263 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 116/236] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:14.205840 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba5d9b-9897-435a-88ee-c1d639918a58 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:14.206231 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba5d9b-9897-435a-88ee-c1d639918a58 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:14.206461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba5d9b-9897-435a-88ee-c1d639918a58 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:14.208095 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 121/237] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:14.213581 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593a28b-c210-4637-a7a3-301b87006a76 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:14.213867 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593a28b-c210-4637-a7a3-301b87006a76 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:14.214142 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593a28b-c210-4637-a7a3-301b87006a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:14.239540 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-3593a28b-c210-4637-a7a3-301b87006a76 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:14.240722 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-3593a28b-c210-4637-a7a3-301b87006a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:14.329003 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 117/238] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:14.474792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba5d9b-9897-435a-88ee-c1d639918a58 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:14.545165 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:14.616035 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba5d9b-9897-435a-88ee-c1d639918a58 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:14.662078 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8a20f-ca1a-4005-8489-87fc99200a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:14.662756 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8a20f-ca1a-4005-8489-87fc99200a31 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:14.663033 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8a20f-ca1a-4005-8489-87fc99200a31 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:14.663304 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8a20f-ca1a-4005-8489-87fc99200a31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:14.667144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8a20f-ca1a-4005-8489-87fc99200a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:14.668655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8a20f-ca1a-4005-8489-87fc99200a31 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:14.670391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 122/239] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:14.676387 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593a28b-c210-4637-a7a3-301b87006a76 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:14.803024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8a20f-ca1a-4005-8489-87fc99200a31 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:14.844265 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593a28b-c210-4637-a7a3-301b87006a76 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:14.879189 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:14.886138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaf5d0-8bc4-4cb2-801f-770ad217c3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:14.886686 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaf5d0-8bc4-4cb2-801f-770ad217c3ff None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:14.893537 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaf5d0-8bc4-4cb2-801f-770ad217c3ff None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:14.893537 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaf5d0-8bc4-4cb2-801f-770ad217c3ff None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:14.893537 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaf5d0-8bc4-4cb2-801f-770ad217c3ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:14.893537 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaf5d0-8bc4-4cb2-801f-770ad217c3ff None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:14.948805 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8a20f-ca1a-4005-8489-87fc99200a31 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:14.964653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:14.966757 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 118/240] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 31 14:53:14 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:53:14.968053 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cecdc1-ae8f-45a1-b83d-563ec88202c2 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:14.968711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cecdc1-ae8f-45a1-b83d-563ec88202c2 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:14.970713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cecdc1-ae8f-45a1-b83d-563ec88202c2 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:14.970713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 119/241] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:14.976436 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be32e0e-0515-4a4b-af00-2f5f83bc701b None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:14.976795 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be32e0e-0515-4a4b-af00-2f5f83bc701b None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:14.977664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be32e0e-0515-4a4b-af00-2f5f83bc701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:15.001317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-1be32e0e-0515-4a4b-af00-2f5f83bc701b None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:15.005068 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c08a6a-d538-4cff-a95f-8942b40b8085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:15.005068 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c08a6a-d538-4cff-a95f-8942b40b8085 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:15.005277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-1be32e0e-0515-4a4b-af00-2f5f83bc701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:15.005350 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c08a6a-d538-4cff-a95f-8942b40b8085 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:15.005350 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c08a6a-d538-4cff-a95f-8942b40b8085 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:15.021387 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c08a6a-d538-4cff-a95f-8942b40b8085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-f2c08a6a-d538-4cff-a95f-8942b40b8085 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:15.032765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:15.034124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:15.034965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:15.034965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:15.034965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:15.034965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:15.034965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:15.034965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:15.034965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:15.034965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:15.034965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:15.034965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:15.034965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:15.034965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:15.037096 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 123/242] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:15.044798 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c08a6a-d538-4cff-a95f-8942b40b8085 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:15.087664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 120/243] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:15.221127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c08a6a-d538-4cff-a95f-8942b40b8085 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:15.259049 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e1e23-b614-4a9a-8c94-080d1c41bc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:15.259667 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e1e23-b614-4a9a-8c94-080d1c41bc36 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:15.259951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e1e23-b614-4a9a-8c94-080d1c41bc36 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:15.260227 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e1e23-b614-4a9a-8c94-080d1c41bc36 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:15.260893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e1e23-b614-4a9a-8c94-080d1c41bc36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:15.261197 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e1e23-b614-4a9a-8c94-080d1c41bc36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:15.262623 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e1e23-b614-4a9a-8c94-080d1c41bc36 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:15.274063 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 124/244] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:15.279439 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be32e0e-0515-4a4b-af00-2f5f83bc701b None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:15.394916 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be32e0e-0515-4a4b-af00-2f5f83bc701b None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:15.422805 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:15.433292 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3f3f5-8570-4d51-96b2-62ef6b41a149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:15.433982 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3f3f5-8570-4d51-96b2-62ef6b41a149 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:15.434271 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3f3f5-8570-4d51-96b2-62ef6b41a149 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:15.434594 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3f3f5-8570-4d51-96b2-62ef6b41a149 None admin] PATH_INFO: `/v3/users/12c97585ba0f408ea66e357c43b59054` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:15.449041 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3f3f5-8570-4d51-96b2-62ef6b41a149 None admin] RBAC: Authorizing `identity:get_user(user_id=12c97585ba0f408ea66e357c43b59054)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:15.450203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e1e23-b614-4a9a-8c94-080d1c41bc36 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:15.450561 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3f3f5-8570-4d51-96b2-62ef6b41a149 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:15.452353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 121/245] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:15 2022] GET /identity/v3/users/12c97585ba0f408ea66e357c43b59054 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:15.457838 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3f3f5-8570-4d51-96b2-62ef6b41a149 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:15.506117 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:15.594549 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e1e23-b614-4a9a-8c94-080d1c41bc36 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:15.601464 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3f3f5-8570-4d51-96b2-62ef6b41a149 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:15.645591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895f6f5-a7a5-4fd4-9849-cbdc2e997eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:15.646358 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895f6f5-a7a5-4fd4-9849-cbdc2e997eb9 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:15.646648 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895f6f5-a7a5-4fd4-9849-cbdc2e997eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:15.646812 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10ab5c-b92e-443d-8f07-cd0abc2c74fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:15.646929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895f6f5-a7a5-4fd4-9849-cbdc2e997eb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:15.647437 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ab5c-b92e-443d-8f07-cd0abc2c74fb None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:15.647717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ab5c-b92e-443d-8f07-cd0abc2c74fb None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:15.647983 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ab5c-b92e-443d-8f07-cd0abc2c74fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:15.659692 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895f6f5-a7a5-4fd4-9849-cbdc2e997eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-7895f6f5-a7a5-4fd4-9849-cbdc2e997eb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:15.666054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:15.666989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:15.668188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 125/246] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:15.673270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895f6f5-a7a5-4fd4-9849-cbdc2e997eb9 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:15.694321 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:15.720855 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10ab5c-b92e-443d-8f07-cd0abc2c74fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:15.722331 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10ab5c-b92e-443d-8f07-cd0abc2c74fb None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:15.780236 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:15.786824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895f6f5-a7a5-4fd4-9849-cbdc2e997eb9 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:15.831801 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 122/247] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:15.835204 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9782843-9d73-41fb-ad3a-71738b5fcb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:15.835823 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9782843-9d73-41fb-ad3a-71738b5fcb15 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:15.836130 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9782843-9d73-41fb-ad3a-71738b5fcb15 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:15.837028 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9782843-9d73-41fb-ad3a-71738b5fcb15 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:15.837730 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9782843-9d73-41fb-ad3a-71738b5fcb15 None admin] RBAC: Adding query filter params (name=member) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:15.838036 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9782843-9d73-41fb-ad3a-71738b5fcb15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:15.839512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9782843-9d73-41fb-ad3a-71738b5fcb15 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:15.841426 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10ab5c-b92e-443d-8f07-cd0abc2c74fb None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:15.849128 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 126/248] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:15.861881 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9782843-9d73-41fb-ad3a-71738b5fcb15 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:15.980260 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9782843-9d73-41fb-ad3a-71738b5fcb15 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:16.021993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:16.030393 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceef0aa-0959-456a-901f-9ab73cf0b3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:16.030978 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceef0aa-0959-456a-901f-9ab73cf0b3e3 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:16.031265 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceef0aa-0959-456a-901f-9ab73cf0b3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:16.031570 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceef0aa-0959-456a-901f-9ab73cf0b3e3 None admin] PATH_INFO: `/v3/users/517f0dbe164e41aca19e6930fb3f4773` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:16.032735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceef0aa-0959-456a-901f-9ab73cf0b3e3 None admin] RBAC: Authorizing `identity:get_user(user_id=517f0dbe164e41aca19e6930fb3f4773)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:16.034217 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceef0aa-0959-456a-901f-9ab73cf0b3e3 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:16.035826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 127/249] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:15 2022] GET /identity/v3/users/517f0dbe164e41aca19e6930fb3f4773 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:16.042099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceef0aa-0959-456a-901f-9ab73cf0b3e3 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:16.073833 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:16.088502 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10ab5c-b92e-443d-8f07-cd0abc2c74fb None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:16.151979 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceef0aa-0959-456a-901f-9ab73cf0b3e3 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:16.182831 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eca391-98c5-4726-82d8-5e3e4f2370a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:16.183493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eca391-98c5-4726-82d8-5e3e4f2370a6 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:16.183774 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eca391-98c5-4726-82d8-5e3e4f2370a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:16.184050 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eca391-98c5-4726-82d8-5e3e4f2370a6 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:16.185417 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eca391-98c5-4726-82d8-5e3e4f2370a6 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:16.190710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eca391-98c5-4726-82d8-5e3e4f2370a6 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:16.192600 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 123/250] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:15 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:16.200410 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78745b93-b8db-404f-a2ff-7a958942b953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:16.201238 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78745b93-b8db-404f-a2ff-7a958942b953 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:16.201616 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78745b93-b8db-404f-a2ff-7a958942b953 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:16.201992 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78745b93-b8db-404f-a2ff-7a958942b953 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:16.203687 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eca391-98c5-4726-82d8-5e3e4f2370a6 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:16.204791 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78745b93-b8db-404f-a2ff-7a958942b953 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:16.206977 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78745b93-b8db-404f-a2ff-7a958942b953 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:16.208735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 128/251] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:16 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:16.223385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78745b93-b8db-404f-a2ff-7a958942b953 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:16.343901 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:16.350965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78745b93-b8db-404f-a2ff-7a958942b953 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:16.393874 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc57538-4967-4baf-aa9f-67a75af04f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:16.394564 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc57538-4967-4baf-aa9f-67a75af04f9f None admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:16.394844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc57538-4967-4baf-aa9f-67a75af04f9f None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:16.395115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc57538-4967-4baf-aa9f-67a75af04f9f None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86/users/517f0dbe164e41aca19e6930fb3f4773/roles/807b71faee4a435e95e2ca3296e64c2e` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:16.398124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc57538-4967-4baf-aa9f-67a75af04f9f None admin] RBAC: Authorizing `identity:create_grant(project_id=a37fe08aba474a1bb58912f977979b86, user_id=517f0dbe164e41aca19e6930fb3f4773, role_id=807b71faee4a435e95e2ca3296e64c2e)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:16.400880 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc57538-4967-4baf-aa9f-67a75af04f9f None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:16.422945 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eca391-98c5-4726-82d8-5e3e4f2370a6 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:16.463313 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b84d8-6656-4986-bbba-0b52b1c942a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:16.464122 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b84d8-6656-4986-bbba-0b52b1c942a6 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:16.464491 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b84d8-6656-4986-bbba-0b52b1c942a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:16.464756 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b84d8-6656-4986-bbba-0b52b1c942a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:16.465515 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b84d8-6656-4986-bbba-0b52b1c942a6 None admin] RBAC: Adding query filter params (role.id=6e5c958fa3a9494db4490551ae5253a9, scope.project.id=a37fe08aba474a1bb58912f977979b86, user.id=12c97585ba0f408ea66e357c43b59054) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:16.465819 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b84d8-6656-4986-bbba-0b52b1c942a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:16.467300 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b84d8-6656-4986-bbba-0b52b1c942a6 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:16.475706 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 124/252] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:16 2022] GET /identity/v3/role_assignments?user.id=12c97585ba0f408ea66e357c43b59054&scope.project.id=a37fe08aba474a1bb58912f977979b86&role.id=6e5c958fa3a9494db4490551ae5253a9 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:16.479914 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 129/253] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:53:16 2022] PUT /identity/v3/projects/a37fe08aba474a1bb58912f977979b86/users/517f0dbe164e41aca19e6930fb3f4773/roles/807b71faee4a435e95e2ca3296e64c2e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 14:53:16.480865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0d54e-35d4-404a-88e5-f023d1c54852 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:16.481147 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0d54e-35d4-404a-88e5-f023d1c54852 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:16.481419 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0d54e-35d4-404a-88e5-f023d1c54852 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:16.483343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 125/254] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:16.489805 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52d216-16fb-4e98-819a-ee343e5a2e1b None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:16.490183 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52d216-16fb-4e98-819a-ee343e5a2e1b None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:16.490601 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52d216-16fb-4e98-819a-ee343e5a2e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:16.512874 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-2c52d216-16fb-4e98-819a-ee343e5a2e1b None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:16.514144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-2c52d216-16fb-4e98-819a-ee343e5a2e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:16.630810 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 130/255] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:16.905417 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359236-8751-4365-8a2f-3182f1cf29e6 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:16.905916 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359236-8751-4365-8a2f-3182f1cf29e6 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:16.905989 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359236-8751-4365-8a2f-3182f1cf29e6 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:16.907791 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 126/256] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:16.913341 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc1ecd-d66d-46f3-9e07-0c099c84d16a None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:16.913747 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc1ecd-d66d-46f3-9e07-0c099c84d16a None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:16.913935 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc1ecd-d66d-46f3-9e07-0c099c84d16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:16.937713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-d6fc1ecd-d66d-46f3-9e07-0c099c84d16a None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:16.938922 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-d6fc1ecd-d66d-46f3-9e07-0c099c84d16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:17.032569 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 131/257] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:17.103036 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63359236-8751-4365-8a2f-3182f1cf29e6 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:17.112749 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:17.248005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63359236-8751-4365-8a2f-3182f1cf29e6 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:17.290657 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537bc53-36d0-4019-8414-58e90f5a3e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:17.291609 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537bc53-36d0-4019-8414-58e90f5a3e22 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:17.292056 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537bc53-36d0-4019-8414-58e90f5a3e22 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:17.292560 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537bc53-36d0-4019-8414-58e90f5a3e22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:17.309103 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537bc53-36d0-4019-8414-58e90f5a3e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-0537bc53-36d0-4019-8414-58e90f5a3e22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:17.314738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:17.315796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:17.316762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:17.316762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:17.316762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:17.316762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:17.316762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:17.316762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:17.316762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:17.316762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:17.316762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:17.316762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:17.316762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:17.316762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:17.318594 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 127/258] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:53:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:17.326524 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc1ecd-d66d-46f3-9e07-0c099c84d16a None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:17.353721 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:17.427430 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537bc53-36d0-4019-8414-58e90f5a3e22 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:17.486005 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc1ecd-d66d-46f3-9e07-0c099c84d16a None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:17.552751 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302b807-f1d1-47dd-a0e0-b5a79fe35536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:17.553292 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302b807-f1d1-47dd-a0e0-b5a79fe35536 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:17.553580 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302b807-f1d1-47dd-a0e0-b5a79fe35536 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:17.553853 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302b807-f1d1-47dd-a0e0-b5a79fe35536 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:17.554554 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302b807-f1d1-47dd-a0e0-b5a79fe35536 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:17.554855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302b807-f1d1-47dd-a0e0-b5a79fe35536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:17.558591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302b807-f1d1-47dd-a0e0-b5a79fe35536 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:17.570323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 132/259] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:17.579311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302b807-f1d1-47dd-a0e0-b5a79fe35536 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:17.598364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:17.671438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537bc53-36d0-4019-8414-58e90f5a3e22 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:17.735884 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf49ddf-1c97-4b13-9043-d3d7149b32ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:17.736912 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf49ddf-1c97-4b13-9043-d3d7149b32ae None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:17.737407 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf49ddf-1c97-4b13-9043-d3d7149b32ae None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:17.737872 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf49ddf-1c97-4b13-9043-d3d7149b32ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:17.759558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf49ddf-1c97-4b13-9043-d3d7149b32ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:17.762360 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-edf49ddf-1c97-4b13-9043-d3d7149b32ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:17.765170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:17.766028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:17.767282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 128/260] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:53:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:17.774976 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf49ddf-1c97-4b13-9043-d3d7149b32ae None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:17.815532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302b807-f1d1-47dd-a0e0-b5a79fe35536 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:17.882509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c812c4-d84e-4099-85a2-92e4051f9b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:17.883169 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c812c4-d84e-4099-85a2-92e4051f9b54 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:17.884024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c812c4-d84e-4099-85a2-92e4051f9b54 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:17.884298 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c812c4-d84e-4099-85a2-92e4051f9b54 None admin] PATH_INFO: `/v3/users/ecc7c3ce6e3b4cd89872a0acaec9c355` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:17.890733 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c812c4-d84e-4099-85a2-92e4051f9b54 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c3ce6e3b4cd89872a0acaec9c355)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:17.892188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c812c4-d84e-4099-85a2-92e4051f9b54 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:17.893789 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 133/261] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:17 2022] GET /identity/v3/users/ecc7c3ce6e3b4cd89872a0acaec9c355 => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:17.899620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c812c4-d84e-4099-85a2-92e4051f9b54 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:17.941139 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf49ddf-1c97-4b13-9043-d3d7149b32ae None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:17.970841 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:17.987352 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bd03f-6617-42bd-8e6d-c1fe44931fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:17.988203 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bd03f-6617-42bd-8e6d-c1fe44931fd3 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:17.988622 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bd03f-6617-42bd-8e6d-c1fe44931fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:17.989027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bd03f-6617-42bd-8e6d-c1fe44931fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:17.989827 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bd03f-6617-42bd-8e6d-c1fe44931fd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:17.995607 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bd03f-6617-42bd-8e6d-c1fe44931fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:17.995607 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bd03f-6617-42bd-8e6d-c1fe44931fd3 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:18.005709 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 129/262] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:18.013095 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bd03f-6617-42bd-8e6d-c1fe44931fd3 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:18.111019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c812c4-d84e-4099-85a2-92e4051f9b54 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:18.150133 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bd03f-6617-42bd-8e6d-c1fe44931fd3 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:18.188498 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53519ae0-08db-468e-8079-31038119b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:18.189376 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53519ae0-08db-468e-8079-31038119b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:18.189823 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53519ae0-08db-468e-8079-31038119b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:18.190415 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53519ae0-08db-468e-8079-31038119b6d5 None admin] PATH_INFO: `/v3/users/ecc7c3ce6e3b4cd89872a0acaec9c355` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:18.191720 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53519ae0-08db-468e-8079-31038119b6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc7c3ce6e3b4cd89872a0acaec9c355)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:18.193292 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53519ae0-08db-468e-8079-31038119b6d5 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:18.195180 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 130/263] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:18 2022] GET /identity/v3/users/ecc7c3ce6e3b4cd89872a0acaec9c355 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:18.203433 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53519ae0-08db-468e-8079-31038119b6d5 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:18.227566 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78704c-1e78-45b6-bb9b-0cd8affd06dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:18.228579 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78704c-1e78-45b6-bb9b-0cd8affd06dd None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:18.228579 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78704c-1e78-45b6-bb9b-0cd8affd06dd None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:18.228766 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78704c-1e78-45b6-bb9b-0cd8affd06dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:18.264209 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:18.280513 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:18.316651 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53519ae0-08db-468e-8079-31038119b6d5 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:18.362902 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ab235-9cf8-4483-b715-7fa4730e24dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:18.363438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ab235-9cf8-4483-b715-7fa4730e24dd None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:18.363710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ab235-9cf8-4483-b715-7fa4730e24dd None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:18.363977 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ab235-9cf8-4483-b715-7fa4730e24dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:18.402415 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78704c-1e78-45b6-bb9b-0cd8affd06dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:18.403961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78704c-1e78-45b6-bb9b-0cd8affd06dd None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:18.492416 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ab235-9cf8-4483-b715-7fa4730e24dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:18.494432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ab235-9cf8-4483-b715-7fa4730e24dd None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:18.595006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:18.606891 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 134/264] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:18.612865 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78704c-1e78-45b6-bb9b-0cd8affd06dd None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:18.644039 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 131/265] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:18.647323 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ab235-9cf8-4483-b715-7fa4730e24dd None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:18.700980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:18.758663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ab235-9cf8-4483-b715-7fa4730e24dd None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:18.794187 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851d964-a3d9-4280-94b3-a5c88f1766cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:18.795158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d964-a3d9-4280-94b3-a5c88f1766cf None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:18.795432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d964-a3d9-4280-94b3-a5c88f1766cf None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:18.795698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d964-a3d9-4280-94b3-a5c88f1766cf None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:18.796818 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851d964-a3d9-4280-94b3-a5c88f1766cf None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:18.798258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851d964-a3d9-4280-94b3-a5c88f1766cf None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:18.800308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 132/266] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:18 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:18.801498 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e6d4-e384-438c-8579-c1efba5c0a08 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:18.801780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e6d4-e384-438c-8579-c1efba5c0a08 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:18.802053 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e6d4-e384-438c-8579-c1efba5c0a08 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:18.803528 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 133/267] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:18.812292 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1e816-96cc-44a4-8d06-c8b23d6648aa None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:18.812732 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1e816-96cc-44a4-8d06-c8b23d6648aa None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:18.813227 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1e816-96cc-44a4-8d06-c8b23d6648aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:18.815592 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78704c-1e78-45b6-bb9b-0cd8affd06dd None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:18.862201 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-dda1e816-96cc-44a4-8d06-c8b23d6648aa None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:18.864850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-dda1e816-96cc-44a4-8d06-c8b23d6648aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:18.865614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078508e-0a48-4587-aa76-218368b2d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:18.866440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078508e-0a48-4587-aa76-218368b2d85b None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:18.866858 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078508e-0a48-4587-aa76-218368b2d85b None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:18.867305 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078508e-0a48-4587-aa76-218368b2d85b None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:18.869013 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078508e-0a48-4587-aa76-218368b2d85b None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:18.870658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078508e-0a48-4587-aa76-218368b2d85b None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:18.874432 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 135/268] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:18 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:18.876278 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078508e-0a48-4587-aa76-218368b2d85b None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:18.918825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:18.986850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078508e-0a48-4587-aa76-218368b2d85b None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:19.000966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:19.013758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 134/269] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:19.015146 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1e816-96cc-44a4-8d06-c8b23d6648aa None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:19.039943 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dbc63-3a5f-4792-b4f4-7e8fddfbaf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:19.040561 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dbc63-3a5f-4792-b4f4-7e8fddfbaf90 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:19.040840 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dbc63-3a5f-4792-b4f4-7e8fddfbaf90 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:19.041115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dbc63-3a5f-4792-b4f4-7e8fddfbaf90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:19.041840 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dbc63-3a5f-4792-b4f4-7e8fddfbaf90 None admin] RBAC: Adding query filter params (role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4, scope.project.id=a37fe08aba474a1bb58912f977979b86, user.id=ecc7c3ce6e3b4cd89872a0acaec9c355) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:19.042146 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dbc63-3a5f-4792-b4f4-7e8fddfbaf90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:19.043636 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dbc63-3a5f-4792-b4f4-7e8fddfbaf90 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:19.054712 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 136/270] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:18 2022] GET /identity/v3/role_assignments?user.id=ecc7c3ce6e3b4cd89872a0acaec9c355&scope.project.id=a37fe08aba474a1bb58912f977979b86&role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:19.058082 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95916b9a-3dce-4a4a-a18d-832bbce85706 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:19.058082 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95916b9a-3dce-4a4a-a18d-832bbce85706 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:19.058082 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95916b9a-3dce-4a4a-a18d-832bbce85706 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:19.058082 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 137/271] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:19.063490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83a2f-9eff-4b33-b8b4-130b297d4c50 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:19.063769 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83a2f-9eff-4b33-b8b4-130b297d4c50 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:19.064043 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83a2f-9eff-4b33-b8b4-130b297d4c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:19.095962 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-edb83a2f-9eff-4b33-b8b4-130b297d4c50 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:19.097171 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-edb83a2f-9eff-4b33-b8b4-130b297d4c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:19.193177 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1e816-96cc-44a4-8d06-c8b23d6648aa None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:19.264357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 138/272] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:19.266585 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd85f0-ea7e-4394-9229-9e3092b93729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:19.267436 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd85f0-ea7e-4394-9229-9e3092b93729 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:19.267894 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd85f0-ea7e-4394-9229-9e3092b93729 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:19.268343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd85f0-ea7e-4394-9229-9e3092b93729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:19.269250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd85f0-ea7e-4394-9229-9e3092b93729 None admin] RBAC: Adding query filter params (role.id=a3a5839e9bda47d8af7a7b707f7a9888, scope.project.id=a37fe08aba474a1bb58912f977979b86, user.id=ecc7c3ce6e3b4cd89872a0acaec9c355) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:19.269735 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd85f0-ea7e-4394-9229-9e3092b93729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:19.271400 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd85f0-ea7e-4394-9229-9e3092b93729 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:19.283420 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 135/273] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:19 2022] GET /identity/v3/role_assignments?user.id=ecc7c3ce6e3b4cd89872a0acaec9c355&scope.project.id=a37fe08aba474a1bb58912f977979b86&role.id=a3a5839e9bda47d8af7a7b707f7a9888 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:19.653988 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb83a2f-9eff-4b33-b8b4-130b297d4c50 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:19.670943 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd85f0-ea7e-4394-9229-9e3092b93729 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:19.706535 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:19.806962 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb83a2f-9eff-4b33-b8b4-130b297d4c50 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:19.822696 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:19.860067 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc23c07-6b8b-4878-86bf-eee795369171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:19.860730 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23c07-6b8b-4878-86bf-eee795369171 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:19.861095 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23c07-6b8b-4878-86bf-eee795369171 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:19.861378 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23c07-6b8b-4878-86bf-eee795369171 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:19.863319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd85f0-ea7e-4394-9229-9e3092b93729 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:19.863455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc23c07-6b8b-4878-86bf-eee795369171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:19.863998 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc23c07-6b8b-4878-86bf-eee795369171 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:19.866009 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 139/274] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:19.867469 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37cbff-f9b7-4eef-9aa5-25edbb2ddf05 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:19.868305 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37cbff-f9b7-4eef-9aa5-25edbb2ddf05 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:19.868584 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37cbff-f9b7-4eef-9aa5-25edbb2ddf05 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:19.870118 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 140/275] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:19.876693 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37cbff-f9b7-4eef-9aa5-25edbb2ddf05 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:19.913544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5415865-8564-4de8-b0e2-f9bccb04bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:19.915354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5415865-8564-4de8-b0e2-f9bccb04bd77 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:19.915829 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5415865-8564-4de8-b0e2-f9bccb04bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:19.916434 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5415865-8564-4de8-b0e2-f9bccb04bd77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:19.929755 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5415865-8564-4de8-b0e2-f9bccb04bd77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-c5415865-8564-4de8-b0e2-f9bccb04bd77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:19.935739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:19.936640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:19.937448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 136/276] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:19.942439 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b6edc-f1eb-4ff4-927c-2f30dbc07f70 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:19.942439 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b6edc-f1eb-4ff4-927c-2f30dbc07f70 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:19.942439 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b6edc-f1eb-4ff4-927c-2f30dbc07f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:19.961162 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-3b6b6edc-f1eb-4ff4-927c-2f30dbc07f70 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:19.963194 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-3b6b6edc-f1eb-4ff4-927c-2f30dbc07f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:20.002541 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37cbff-f9b7-4eef-9aa5-25edbb2ddf05 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:20.037809 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 137/277] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:20.038709 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b6edc-f1eb-4ff4-927c-2f30dbc07f70 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:20.050379 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:20.051347 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e91e4a-02ca-41f7-9051-de3231738186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:20.051955 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e91e4a-02ca-41f7-9051-de3231738186 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:20.052233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e91e4a-02ca-41f7-9051-de3231738186 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:20.052500 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e91e4a-02ca-41f7-9051-de3231738186 None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:20.053148 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e91e4a-02ca-41f7-9051-de3231738186 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:20.054635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e91e4a-02ca-41f7-9051-de3231738186 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:20.139221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 141/278] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 31 14:53:19 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 14:53:20.141105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae9b0-8d92-4bb2-8a44-8bf612d645ee None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:20.141411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae9b0-8d92-4bb2-8a44-8bf612d645ee None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:20.141690 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae9b0-8d92-4bb2-8a44-8bf612d645ee None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:20.146350 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 142/279] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:20.146535 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b6edc-f1eb-4ff4-927c-2f30dbc07f70 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:20.153625 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c062cd4-8034-41f3-8e49-2be3a8924294 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:20.154376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c062cd4-8034-41f3-8e49-2be3a8924294 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:20.154862 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c062cd4-8034-41f3-8e49-2be3a8924294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:20.183436 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-4c062cd4-8034-41f3-8e49-2be3a8924294 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:20.185441 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-4c062cd4-8034-41f3-8e49-2be3a8924294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:20.188014 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fe420-b5d5-4b28-92ff-e2bba95356ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:20.188711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fe420-b5d5-4b28-92ff-e2bba95356ec None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:20.189055 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fe420-b5d5-4b28-92ff-e2bba95356ec None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:20.189399 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fe420-b5d5-4b28-92ff-e2bba95356ec None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:20.190176 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fe420-b5d5-4b28-92ff-e2bba95356ec None admin] RBAC: Adding query filter params (name=member) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:20.190762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fe420-b5d5-4b28-92ff-e2bba95356ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:20.192322 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fe420-b5d5-4b28-92ff-e2bba95356ec None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:20.203479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 138/280] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:20.209242 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fe420-b5d5-4b28-92ff-e2bba95356ec None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:20.228205 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:20.293949 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 143/281] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:20.309900 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:20.346810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fe420-b5d5-4b28-92ff-e2bba95356ec None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:20.384694 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1f30-ac8b-4571-b0a1-9ab3e603317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:20.385334 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1f30-ac8b-4571-b0a1-9ab3e603317a None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:20.385615 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1f30-ac8b-4571-b0a1-9ab3e603317a None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:20.385885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1f30-ac8b-4571-b0a1-9ab3e603317a None admin] PATH_INFO: `/v3/users/efab5e7d9e5945588430151ddfe52d6b` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:20.395856 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c062cd4-8034-41f3-8e49-2be3a8924294 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:20.400666 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f1f30-ac8b-4571-b0a1-9ab3e603317a None admin] RBAC: Authorizing `identity:get_user(user_id=efab5e7d9e5945588430151ddfe52d6b)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:20.402394 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f1f30-ac8b-4571-b0a1-9ab3e603317a None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:20.404193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 139/282] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:20 2022] GET /identity/v3/users/efab5e7d9e5945588430151ddfe52d6b => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:20.409885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1f30-ac8b-4571-b0a1-9ab3e603317a None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:20.532708 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c062cd4-8034-41f3-8e49-2be3a8924294 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:20.534993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1f30-ac8b-4571-b0a1-9ab3e603317a None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:20.569343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:20.578878 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53ab7-1584-4a6c-b8ed-2be1fa36be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:20.579762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53ab7-1584-4a6c-b8ed-2be1fa36be2e None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:20.580203 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53ab7-1584-4a6c-b8ed-2be1fa36be2e None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:20.580476 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53ab7-1584-4a6c-b8ed-2be1fa36be2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:20.581203 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b53ab7-1584-4a6c-b8ed-2be1fa36be2e None admin] RBAC: Adding query filter params (role.id=807b71faee4a435e95e2ca3296e64c2e, user.id=efab5e7d9e5945588430151ddfe52d6b, scope.system=all) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:20.581515 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b53ab7-1584-4a6c-b8ed-2be1fa36be2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:20.582133 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a521c35-4cb8-492a-b853-36cce20d7056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:20.583034 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b53ab7-1584-4a6c-b8ed-2be1fa36be2e None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:20.588750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521c35-4cb8-492a-b853-36cce20d7056 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:20.588750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521c35-4cb8-492a-b853-36cce20d7056 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:20.588750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521c35-4cb8-492a-b853-36cce20d7056 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:20.593563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 140/283] 10.222.0.52 () {56 vars in 1308 bytes} [Wed Aug 31 14:53:20 2022] GET /identity/v3/role_assignments?user.id=efab5e7d9e5945588430151ddfe52d6b&scope.system=all&role.id=807b71faee4a435e95e2ca3296e64c2e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:20.596455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a521c35-4cb8-492a-b853-36cce20d7056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-6a521c35-4cb8-492a-b853-36cce20d7056 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:20.601716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:20.603276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:20.604056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:20.604056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:20.604056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:20.604056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:20.604056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:20.604056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:20.604056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:20.604056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:20.604056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:20.604056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:20.604056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:20.604056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:20.606840 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 144/284] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:20.612761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53ab7-1584-4a6c-b8ed-2be1fa36be2e None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:20.648751 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a521c35-4cb8-492a-b853-36cce20d7056 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:20.679221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:20.769917 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53ab7-1584-4a6c-b8ed-2be1fa36be2e None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:20.801317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a521c35-4cb8-492a-b853-36cce20d7056 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:20.819399 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510551f4-a019-4039-b8c4-3fe2d1ee9b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:20.820099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510551f4-a019-4039-b8c4-3fe2d1ee9b92 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:20.820455 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510551f4-a019-4039-b8c4-3fe2d1ee9b92 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:20.821333 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510551f4-a019-4039-b8c4-3fe2d1ee9b92 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:20.822560 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510551f4-a019-4039-b8c4-3fe2d1ee9b92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:20.823323 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510551f4-a019-4039-b8c4-3fe2d1ee9b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:20.825136 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510551f4-a019-4039-b8c4-3fe2d1ee9b92 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:20.842831 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 141/285] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:20.850982 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510551f4-a019-4039-b8c4-3fe2d1ee9b92 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:20.856076 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511326f8-0f32-448d-b5d4-373f048121a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:20.857090 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511326f8-0f32-448d-b5d4-373f048121a0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:20.857834 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511326f8-0f32-448d-b5d4-373f048121a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:20.858335 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511326f8-0f32-448d-b5d4-373f048121a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:20.873496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511326f8-0f32-448d-b5d4-373f048121a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-511326f8-0f32-448d-b5d4-373f048121a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:20.886322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:20.887244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:20.888025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:20.888025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:20.888025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:20.888025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:20.888025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:20.888025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:20.888025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:20.888025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:20.888025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:20.888025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:20.888025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:20.888025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:20.889087 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 145/286] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:20.893166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511326f8-0f32-448d-b5d4-373f048121a0 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:20.938716 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:20.983892 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510551f4-a019-4039-b8c4-3fe2d1ee9b92 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:21.029602 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be30033-2723-464b-b25a-f93dad28b100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:21.030243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be30033-2723-464b-b25a-f93dad28b100 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:21.030547 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be30033-2723-464b-b25a-f93dad28b100 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:21.030820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be30033-2723-464b-b25a-f93dad28b100 None admin] PATH_INFO: `/v3/users/12c97585ba0f408ea66e357c43b59054` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:21.032705 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be30033-2723-464b-b25a-f93dad28b100 None admin] RBAC: Authorizing `identity:get_user(user_id=12c97585ba0f408ea66e357c43b59054)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:21.034142 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be30033-2723-464b-b25a-f93dad28b100 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:21.035772 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 142/287] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:20 2022] GET /identity/v3/users/12c97585ba0f408ea66e357c43b59054 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:21.051101 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be30033-2723-464b-b25a-f93dad28b100 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:21.079078 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:21.103771 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511326f8-0f32-448d-b5d4-373f048121a0 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:21.167066 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dee97-c68a-42a4-b5b8-738f082ee0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:21.167913 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dee97-c68a-42a4-b5b8-738f082ee0cd None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:21.168320 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dee97-c68a-42a4-b5b8-738f082ee0cd None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:21.168750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dee97-c68a-42a4-b5b8-738f082ee0cd None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:21.169540 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dee97-c68a-42a4-b5b8-738f082ee0cd None admin] RBAC: Adding query filter params (name=member) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:21.170009 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dee97-c68a-42a4-b5b8-738f082ee0cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:21.174264 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dee97-c68a-42a4-b5b8-738f082ee0cd None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:21.184094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 146/288] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:21.190910 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dee97-c68a-42a4-b5b8-738f082ee0cd None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:21.270107 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be30033-2723-464b-b25a-f93dad28b100 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:21.309382 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:21.332734 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f273b-8fb7-48d1-a726-131847923422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:21.333304 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f273b-8fb7-48d1-a726-131847923422 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:21.333587 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f273b-8fb7-48d1-a726-131847923422 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:21.333858 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f273b-8fb7-48d1-a726-131847923422 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:21.337368 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f273b-8fb7-48d1-a726-131847923422 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:21.338856 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f273b-8fb7-48d1-a726-131847923422 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:21.347352 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 143/289] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:21 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:21.353204 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f273b-8fb7-48d1-a726-131847923422 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:21.383182 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dee97-c68a-42a4-b5b8-738f082ee0cd None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:21.422697 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ec20e-b6fd-4e0b-97f2-7b3d2c021396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:21.423765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ec20e-b6fd-4e0b-97f2-7b3d2c021396 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:21.424202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ec20e-b6fd-4e0b-97f2-7b3d2c021396 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:21.424612 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ec20e-b6fd-4e0b-97f2-7b3d2c021396 None admin] PATH_INFO: `/v3/users/517f0dbe164e41aca19e6930fb3f4773` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:21.426004 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ec20e-b6fd-4e0b-97f2-7b3d2c021396 None admin] RBAC: Authorizing `identity:get_user(user_id=517f0dbe164e41aca19e6930fb3f4773)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:21.427586 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ec20e-b6fd-4e0b-97f2-7b3d2c021396 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:21.429319 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 147/290] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:21 2022] GET /identity/v3/users/517f0dbe164e41aca19e6930fb3f4773 => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:21.435776 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ec20e-b6fd-4e0b-97f2-7b3d2c021396 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:21.456048 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:21.591643 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ec20e-b6fd-4e0b-97f2-7b3d2c021396 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:21.594662 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f273b-8fb7-48d1-a726-131847923422 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:21.655232 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47308aad-c44c-4224-8bde-933baaa48467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:21.655903 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47308aad-c44c-4224-8bde-933baaa48467 None admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:21.656195 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47308aad-c44c-4224-8bde-933baaa48467 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:21.656471 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47308aad-c44c-4224-8bde-933baaa48467 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86/users/12c97585ba0f408ea66e357c43b59054/roles/6e5c958fa3a9494db4490551ae5253a9` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:21.659213 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47308aad-c44c-4224-8bde-933baaa48467 None admin] RBAC: Authorizing `identity:create_grant(project_id=a37fe08aba474a1bb58912f977979b86, user_id=12c97585ba0f408ea66e357c43b59054, role_id=6e5c958fa3a9494db4490551ae5253a9)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:21.660656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47308aad-c44c-4224-8bde-933baaa48467 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:21.664336 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a0f21-aad3-49f4-a41b-3768559f0e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:21.666268 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a0f21-aad3-49f4-a41b-3768559f0e8d None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:21.666575 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a0f21-aad3-49f4-a41b-3768559f0e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:21.666860 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a0f21-aad3-49f4-a41b-3768559f0e8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:21.738325 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a0f21-aad3-49f4-a41b-3768559f0e8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:21.739929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a0f21-aad3-49f4-a41b-3768559f0e8d None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:21.748507 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 144/291] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:53:21 2022] PUT /identity/v3/projects/a37fe08aba474a1bb58912f977979b86/users/12c97585ba0f408ea66e357c43b59054/roles/6e5c958fa3a9494db4490551ae5253a9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 14:53:21.768505 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:21.906692 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 148/292] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:21.912517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47308aad-c44c-4224-8bde-933baaa48467 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:21.980373 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:22.037900 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47308aad-c44c-4224-8bde-933baaa48467 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:22.074885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69aa4d-4fae-4913-a819-138ea133d1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:22.075635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69aa4d-4fae-4913-a819-138ea133d1eb None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:22.075799 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69aa4d-4fae-4913-a819-138ea133d1eb None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:22.076149 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69aa4d-4fae-4913-a819-138ea133d1eb None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:22.077381 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69aa4d-4fae-4913-a819-138ea133d1eb None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:22.078872 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69aa4d-4fae-4913-a819-138ea133d1eb None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:22.080850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 145/293] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:21 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:22.086846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a0f21-aad3-49f4-a41b-3768559f0e8d None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:22.195231 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a0f21-aad3-49f4-a41b-3768559f0e8d None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:22.214331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:22.246081 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06d6c9-cd2c-4d0d-a061-c5190829f2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:22.246724 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06d6c9-cd2c-4d0d-a061-c5190829f2ba None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:22.247006 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06d6c9-cd2c-4d0d-a061-c5190829f2ba None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:22.247278 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06d6c9-cd2c-4d0d-a061-c5190829f2ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:22.248006 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06d6c9-cd2c-4d0d-a061-c5190829f2ba None admin] RBAC: Adding query filter params (role.id=807b71faee4a435e95e2ca3296e64c2e, scope.project.id=a37fe08aba474a1bb58912f977979b86, user.id=517f0dbe164e41aca19e6930fb3f4773) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:22.248314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06d6c9-cd2c-4d0d-a061-c5190829f2ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:22.250818 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06d6c9-cd2c-4d0d-a061-c5190829f2ba None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:22.259275 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 149/294] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:22 2022] GET /identity/v3/role_assignments?user.id=517f0dbe164e41aca19e6930fb3f4773&scope.project.id=a37fe08aba474a1bb58912f977979b86&role.id=807b71faee4a435e95e2ca3296e64c2e => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:22.839864 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6708727-4ed8-4336-8801-51acb02ae163 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:22.840257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6708727-4ed8-4336-8801-51acb02ae163 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:22.840433 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6708727-4ed8-4336-8801-51acb02ae163 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:22.841927 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 146/295] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:22.853317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979280f5-fefd-489c-a022-65b63a56c432 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:22.853739 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979280f5-fefd-489c-a022-65b63a56c432 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:22.853908 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979280f5-fefd-489c-a022-65b63a56c432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:22.879640 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-979280f5-fefd-489c-a022-65b63a56c432 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:22.880860 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-979280f5-fefd-489c-a022-65b63a56c432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:22.953144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 150/296] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:23.179131 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b69ff-61b2-4d18-a942-327d610f29a2 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:23.179664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b69ff-61b2-4d18-a942-327d610f29a2 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:23.179664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b69ff-61b2-4d18-a942-327d610f29a2 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:23.182286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 147/297] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:23.188307 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1805f-086b-4c34-ac55-d4981b8a56af None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:23.188602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1805f-086b-4c34-ac55-d4981b8a56af None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:23.188995 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1805f-086b-4c34-ac55-d4981b8a56af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:23.208681 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-bbb1805f-086b-4c34-ac55-d4981b8a56af None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:23.209888 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-bbb1805f-086b-4c34-ac55-d4981b8a56af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:23.281289 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 151/298] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:23.299597 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b69ff-61b2-4d18-a942-327d610f29a2 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:23.345823 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949c11-5e4b-47ec-97c2-62c696db9354 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:23.346479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949c11-5e4b-47ec-97c2-62c696db9354 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:23.346958 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949c11-5e4b-47ec-97c2-62c696db9354 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:23.348746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 152/299] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:53:23.354586 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db056661-bd2b-4f73-ade2-b5938637ffec None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:23.355093 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db056661-bd2b-4f73-ade2-b5938637ffec None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:23.355527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db056661-bd2b-4f73-ade2-b5938637ffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:23.374642 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-db056661-bd2b-4f73-ade2-b5938637ffec None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:23.376081 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-db056661-bd2b-4f73-ade2-b5938637ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:23.403967 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:23.417991 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b69ff-61b2-4d18-a942-327d610f29a2 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:23.438946 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:23.454599 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 153/300] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:23.458035 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3c3eb-7f1c-40c7-a7e3-420ad6c03b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:23.458839 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3c3eb-7f1c-40c7-a7e3-420ad6c03b12 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:23.459174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3c3eb-7f1c-40c7-a7e3-420ad6c03b12 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:23.459456 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3c3eb-7f1c-40c7-a7e3-420ad6c03b12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:23.471068 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3c3eb-7f1c-40c7-a7e3-420ad6c03b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-89c3c3eb-7f1c-40c7-a7e3-420ad6c03b12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:23.476225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:23.477715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:23.478527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 148/301] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:23.484233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db056661-bd2b-4f73-ade2-b5938637ffec None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:23.589939 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db056661-bd2b-4f73-ade2-b5938637ffec None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:23.626696 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5832c7-4766-4fdf-9d4d-ea07d0b5cbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:23.627318 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5832c7-4766-4fdf-9d4d-ea07d0b5cbd5 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:23.628407 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3c3eb-7f1c-40c7-a7e3-420ad6c03b12 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:23.630560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5832c7-4766-4fdf-9d4d-ea07d0b5cbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:23.631067 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5832c7-4766-4fdf-9d4d-ea07d0b5cbd5 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:23.631987 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5832c7-4766-4fdf-9d4d-ea07d0b5cbd5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:23.632500 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5832c7-4766-4fdf-9d4d-ea07d0b5cbd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:23.634174 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5832c7-4766-4fdf-9d4d-ea07d0b5cbd5 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:23.643270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 154/302] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:23.650275 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5832c7-4766-4fdf-9d4d-ea07d0b5cbd5 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:23.686956 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:23.755463 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3c3eb-7f1c-40c7-a7e3-420ad6c03b12 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:23.782263 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5832c7-4766-4fdf-9d4d-ea07d0b5cbd5 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:23.800672 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f18fb-6df0-4409-8d5c-cc29c633c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:23.801311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f18fb-6df0-4409-8d5c-cc29c633c54b None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:23.801590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f18fb-6df0-4409-8d5c-cc29c633c54b None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:23.801860 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f18fb-6df0-4409-8d5c-cc29c633c54b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:23.803653 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f18fb-6df0-4409-8d5c-cc29c633c54b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:23.805170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f18fb-6df0-4409-8d5c-cc29c633c54b None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:23.810321 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 149/303] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:23.813576 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f18fb-6df0-4409-8d5c-cc29c633c54b None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:23.826961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abec28c-1ffc-464b-a41f-fb196dedd9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:23.827704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abec28c-1ffc-464b-a41f-fb196dedd9ff None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:23.828105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abec28c-1ffc-464b-a41f-fb196dedd9ff None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:23.828454 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abec28c-1ffc-464b-a41f-fb196dedd9ff None admin] PATH_INFO: `/v3/users/fb7a5fd6ecdf46d0b5d33d81e5e4fc8d` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:23.844246 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abec28c-1ffc-464b-a41f-fb196dedd9ff None admin] RBAC: Authorizing `identity:get_user(user_id=fb7a5fd6ecdf46d0b5d33d81e5e4fc8d)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:23.845734 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abec28c-1ffc-464b-a41f-fb196dedd9ff None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:23.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 155/304] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:23 2022] GET /identity/v3/users/fb7a5fd6ecdf46d0b5d33d81e5e4fc8d => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:23.848339 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abec28c-1ffc-464b-a41f-fb196dedd9ff None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:23.876146 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:23.934479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f18fb-6df0-4409-8d5c-cc29c633c54b None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:23.946516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:23.968299 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abec28c-1ffc-464b-a41f-fb196dedd9ff None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:23.969948 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93199002-2001-4a83-9280-f26a19097707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:23.970590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93199002-2001-4a83-9280-f26a19097707 None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:23.970876 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93199002-2001-4a83-9280-f26a19097707 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:23.971152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93199002-2001-4a83-9280-f26a19097707 None admin] PATH_INFO: `/v3/groups` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:23.971784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93199002-2001-4a83-9280-f26a19097707 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:23.973188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93199002-2001-4a83-9280-f26a19097707 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:24.007234 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08053495-9568-4614-989c-0708a23f9e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:24.007890 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053495-9568-4614-989c-0708a23f9e38 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:24.008209 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053495-9568-4614-989c-0708a23f9e38 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:24.008989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053495-9568-4614-989c-0708a23f9e38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:24.019492 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08053495-9568-4614-989c-0708a23f9e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-08053495-9568-4614-989c-0708a23f9e38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:24.024373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:24.025530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 156/305] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:24.026709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08053495-9568-4614-989c-0708a23f9e38 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:24.050339 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 150/306] 10.222.0.52 () {60 vars in 1134 bytes} [Wed Aug 31 14:53:23 2022] POST /identity/v3/groups => generated 229 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:53:24.050339 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93199002-2001-4a83-9280-f26a19097707 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:24.178350 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93199002-2001-4a83-9280-f26a19097707 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:24.189411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08053495-9568-4614-989c-0708a23f9e38 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:24.189649 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:24.230608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88125f2-5da3-4b3e-9268-519b193543a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:24.231238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88125f2-5da3-4b3e-9268-519b193543a4 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:24.231525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88125f2-5da3-4b3e-9268-519b193543a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:24.231802 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88125f2-5da3-4b3e-9268-519b193543a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:24.233260 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88125f2-5da3-4b3e-9268-519b193543a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:24.233756 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88125f2-5da3-4b3e-9268-519b193543a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:24.234099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baef9ee-a4bf-44f8-bc0a-898e06097b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:24.235352 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baef9ee-a4bf-44f8-bc0a-898e06097b04 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:24.235560 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88125f2-5da3-4b3e-9268-519b193543a4 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:24.236116 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baef9ee-a4bf-44f8-bc0a-898e06097b04 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:24.236662 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baef9ee-a4bf-44f8-bc0a-898e06097b04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:24.237588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baef9ee-a4bf-44f8-bc0a-898e06097b04 None admin] RBAC: Adding query filter params (role.id=6e5c958fa3a9494db4490551ae5253a9, user.id=fb7a5fd6ecdf46d0b5d33d81e5e4fc8d, scope.system=all) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:24.238096 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baef9ee-a4bf-44f8-bc0a-898e06097b04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:24.239926 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baef9ee-a4bf-44f8-bc0a-898e06097b04 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:24.246077 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 151/307] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:24.246928 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 157/308] 10.222.0.52 () {56 vars in 1308 bytes} [Wed Aug 31 14:53:24 2022] GET /identity/v3/role_assignments?user.id=fb7a5fd6ecdf46d0b5d33d81e5e4fc8d&scope.system=all&role.id=6e5c958fa3a9494db4490551ae5253a9 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:24.251449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88125f2-5da3-4b3e-9268-519b193543a4 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:24.324441 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51ef06-4758-4739-87a7-ee1ee81c6fda None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:24.324742 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51ef06-4758-4739-87a7-ee1ee81c6fda None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:24.324932 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51ef06-4758-4739-87a7-ee1ee81c6fda None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:24.326274 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 158/309] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:53:24.331935 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7867a03-2bcb-4cff-9ae4-340c8c87d64b None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:24.332219 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7867a03-2bcb-4cff-9ae4-340c8c87d64b None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:24.332493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7867a03-2bcb-4cff-9ae4-340c8c87d64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:24.356525 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-e7867a03-2bcb-4cff-9ae4-340c8c87d64b None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:24.358169 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-e7867a03-2bcb-4cff-9ae4-340c8c87d64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:24.360380 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:24.379532 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88125f2-5da3-4b3e-9268-519b193543a4 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:24.422014 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c459383-212f-4603-a2fa-ae396a5ed6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:24.422812 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c459383-212f-4603-a2fa-ae396a5ed6dc None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:24.423098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c459383-212f-4603-a2fa-ae396a5ed6dc None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:24.423411 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c459383-212f-4603-a2fa-ae396a5ed6dc None admin] PATH_INFO: `/v3/users/efab5e7d9e5945588430151ddfe52d6b` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:24.424582 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c459383-212f-4603-a2fa-ae396a5ed6dc None admin] RBAC: Authorizing `identity:get_user(user_id=efab5e7d9e5945588430151ddfe52d6b)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:24.426169 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c459383-212f-4603-a2fa-ae396a5ed6dc None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:24.428263 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 152/310] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:24 2022] GET /identity/v3/users/efab5e7d9e5945588430151ddfe52d6b => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:24.434514 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c459383-212f-4603-a2fa-ae396a5ed6dc None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:24.444696 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 159/311] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:24.477439 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:24.541289 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c459383-212f-4603-a2fa-ae396a5ed6dc None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:24.577134 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff955c-2583-4cba-9fb5-9747383a4dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:24.577766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff955c-2583-4cba-9fb5-9747383a4dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:24.578043 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff955c-2583-4cba-9fb5-9747383a4dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:24.578329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff955c-2583-4cba-9fb5-9747383a4dc5 None admin] PATH_INFO: `/v3/system/users/efab5e7d9e5945588430151ddfe52d6b/roles/807b71faee4a435e95e2ca3296e64c2e` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:24.579811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff955c-2583-4cba-9fb5-9747383a4dc5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=efab5e7d9e5945588430151ddfe52d6b, role_id=807b71faee4a435e95e2ca3296e64c2e)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:24.581250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff955c-2583-4cba-9fb5-9747383a4dc5 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:24.693688 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 153/312] 10.222.0.52 () {58 vars in 1334 bytes} [Wed Aug 31 14:53:24 2022] PUT /identity/v3/system/users/efab5e7d9e5945588430151ddfe52d6b/roles/807b71faee4a435e95e2ca3296e64c2e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:53:24.780786 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7867a03-2bcb-4cff-9ae4-340c8c87d64b None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:24.895559 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7867a03-2bcb-4cff-9ae4-340c8c87d64b None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:24.932469 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72298161-1562-45bd-936c-80cb8fbfd883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:24.933108 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72298161-1562-45bd-936c-80cb8fbfd883 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:24.933386 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72298161-1562-45bd-936c-80cb8fbfd883 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:24.933655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72298161-1562-45bd-936c-80cb8fbfd883 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:24.944087 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72298161-1562-45bd-936c-80cb8fbfd883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-72298161-1562-45bd-936c-80cb8fbfd883 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:24.949123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:24.950487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:24.951788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:24.954630 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 160/313] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:24.956391 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff955c-2583-4cba-9fb5-9747383a4dc5 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:25.057141 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:25.060420 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff955c-2583-4cba-9fb5-9747383a4dc5 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:25.129852 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400fff5-5182-4c68-bdc0-73cb065eab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:25.131000 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400fff5-5182-4c68-bdc0-73cb065eab04 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:25.131614 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400fff5-5182-4c68-bdc0-73cb065eab04 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:25.131889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400fff5-5182-4c68-bdc0-73cb065eab04 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:25.132558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400fff5-5182-4c68-bdc0-73cb065eab04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:25.132862 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400fff5-5182-4c68-bdc0-73cb065eab04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:25.134320 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400fff5-5182-4c68-bdc0-73cb065eab04 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:25.142867 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 154/314] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:25.148612 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72298161-1562-45bd-936c-80cb8fbfd883 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:25.257726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72298161-1562-45bd-936c-80cb8fbfd883 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:25.294844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310697b-1e93-4345-8769-b0c296c92811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:25.295546 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310697b-1e93-4345-8769-b0c296c92811 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:25.295834 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310697b-1e93-4345-8769-b0c296c92811 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:25.296111 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310697b-1e93-4345-8769-b0c296c92811 None admin] PATH_INFO: `/v3/users/12c97585ba0f408ea66e357c43b59054` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:25.297261 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310697b-1e93-4345-8769-b0c296c92811 None admin] RBAC: Authorizing `identity:get_user(user_id=12c97585ba0f408ea66e357c43b59054)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:25.298812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310697b-1e93-4345-8769-b0c296c92811 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:25.300914 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 161/315] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:25 2022] GET /identity/v3/users/12c97585ba0f408ea66e357c43b59054 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:25.306638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400fff5-5182-4c68-bdc0-73cb065eab04 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:25.413300 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400fff5-5182-4c68-bdc0-73cb065eab04 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:25.448770 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feabfb1-2650-4cd6-9bfe-fc84eb28f997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:25.449400 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feabfb1-2650-4cd6-9bfe-fc84eb28f997 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:25.449678 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feabfb1-2650-4cd6-9bfe-fc84eb28f997 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:25.449949 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feabfb1-2650-4cd6-9bfe-fc84eb28f997 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:25.482446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:25.521742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feabfb1-2650-4cd6-9bfe-fc84eb28f997 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:25.526451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feabfb1-2650-4cd6-9bfe-fc84eb28f997 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:25.626889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 155/316] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:25.635465 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310697b-1e93-4345-8769-b0c296c92811 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:25.704200 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:25.740477 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310697b-1e93-4345-8769-b0c296c92811 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:25.777582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf47d9e-17ea-49a6-9bea-3d3b3390a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:25.778217 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf47d9e-17ea-49a6-9bea-3d3b3390a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:25.778527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf47d9e-17ea-49a6-9bea-3d3b3390a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:25.778923 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf47d9e-17ea-49a6-9bea-3d3b3390a1d8 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:25.780116 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf47d9e-17ea-49a6-9bea-3d3b3390a1d8 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:25.781563 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf47d9e-17ea-49a6-9bea-3d3b3390a1d8 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:25.783598 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 162/317] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:25 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:25.789484 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feabfb1-2650-4cd6-9bfe-fc84eb28f997 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:25.856375 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:25.898190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feabfb1-2650-4cd6-9bfe-fc84eb28f997 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:25.934655 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539b363-fbc0-4ada-8520-5a5734e8f5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:25.935633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539b363-fbc0-4ada-8520-5a5734e8f5c9 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:25.936063 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539b363-fbc0-4ada-8520-5a5734e8f5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:25.936495 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539b363-fbc0-4ada-8520-5a5734e8f5c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:25.937395 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539b363-fbc0-4ada-8520-5a5734e8f5c9 None admin] RBAC: Adding query filter params (role.id=6e5c958fa3a9494db4490551ae5253a9, scope.project.id=a37fe08aba474a1bb58912f977979b86, user.id=12c97585ba0f408ea66e357c43b59054) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:25.937953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539b363-fbc0-4ada-8520-5a5734e8f5c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:25.939633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539b363-fbc0-4ada-8520-5a5734e8f5c9 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:25.947796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 156/318] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:25 2022] GET /identity/v3/role_assignments?user.id=12c97585ba0f408ea66e357c43b59054&scope.project.id=a37fe08aba474a1bb58912f977979b86&role.id=6e5c958fa3a9494db4490551ae5253a9 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:26.458763 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33f140-f465-48bd-b864-2c03a050450d None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:26.459280 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33f140-f465-48bd-b864-2c03a050450d None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:26.459385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33f140-f465-48bd-b864-2c03a050450d None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:26.460833 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 163/319] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:26.465889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e456058-f9b4-44cc-81c2-ab13781ea3cf None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:26.466274 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e456058-f9b4-44cc-81c2-ab13781ea3cf None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:26.466462 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e456058-f9b4-44cc-81c2-ab13781ea3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:26.485213 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-9e456058-f9b4-44cc-81c2-ab13781ea3cf None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:26.486420 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-9e456058-f9b4-44cc-81c2-ab13781ea3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:26.554540 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 157/320] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:26.579445 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d03532-b3cc-4829-a83e-51c3ff966f55 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:26.579739 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d03532-b3cc-4829-a83e-51c3ff966f55 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:26.579997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d03532-b3cc-4829-a83e-51c3ff966f55 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:26.581497 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 164/321] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:26.586553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f4d70-0dc1-4edc-b98b-961230da24c8 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:26.586855 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f4d70-0dc1-4edc-b98b-961230da24c8 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:26.587165 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f4d70-0dc1-4edc-b98b-961230da24c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:26.605632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-aa1f4d70-0dc1-4edc-b98b-961230da24c8 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:26.606848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-aa1f4d70-0dc1-4edc-b98b-961230da24c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:26.658147 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:26.675596 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 158/322] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:26.885938 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d03532-b3cc-4829-a83e-51c3ff966f55 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:26.994212 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d03532-b3cc-4829-a83e-51c3ff966f55 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:27.003185 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f4d70-0dc1-4edc-b98b-961230da24c8 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:27.033494 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d64373-0745-4de0-8388-a315e9a475bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:27.034123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d64373-0745-4de0-8388-a315e9a475bc None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:27.034425 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d64373-0745-4de0-8388-a315e9a475bc None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:27.034694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d64373-0745-4de0-8388-a315e9a475bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:27.035793 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d64373-0745-4de0-8388-a315e9a475bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:27.037224 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d64373-0745-4de0-8388-a315e9a475bc None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:27.038967 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 165/323] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:27.044853 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d64373-0745-4de0-8388-a315e9a475bc None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:27.047514 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:27.119234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f4d70-0dc1-4edc-b98b-961230da24c8 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:27.148470 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d64373-0745-4de0-8388-a315e9a475bc None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:27.155961 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215feaa1-bae3-43f6-8795-11f054e062f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:27.156597 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215feaa1-bae3-43f6-8795-11f054e062f1 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:27.156873 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215feaa1-bae3-43f6-8795-11f054e062f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:27.157181 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215feaa1-bae3-43f6-8795-11f054e062f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:27.167533 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215feaa1-bae3-43f6-8795-11f054e062f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-215feaa1-bae3-43f6-8795-11f054e062f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:27.172446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:27.181202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 159/324] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:27.182205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e902b1-d4df-4ace-9f7a-6c1b37be5234 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:27.183132 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e902b1-d4df-4ace-9f7a-6c1b37be5234 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:27.183132 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e902b1-d4df-4ace-9f7a-6c1b37be5234 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:27.183132 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 160/325] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:27.183132 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e902b1-d4df-4ace-9f7a-6c1b37be5234 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:27.191140 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb031ca4-9abc-4d41-aab1-5faf9943d8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:27.191743 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb031ca4-9abc-4d41-aab1-5faf9943d8d1 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:27.192015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb031ca4-9abc-4d41-aab1-5faf9943d8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:27.192281 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb031ca4-9abc-4d41-aab1-5faf9943d8d1 None admin] PATH_INFO: `/v3/groups` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:27.192984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb031ca4-9abc-4d41-aab1-5faf9943d8d1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:27.194765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb031ca4-9abc-4d41-aab1-5faf9943d8d1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:27.229850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:27.284297 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e902b1-d4df-4ace-9f7a-6c1b37be5234 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:27.316799 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad1db9-716b-46d1-829d-01ec8f8e8f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:27.317405 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad1db9-716b-46d1-829d-01ec8f8e8f5e None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:27.317686 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad1db9-716b-46d1-829d-01ec8f8e8f5e None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:27.317960 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad1db9-716b-46d1-829d-01ec8f8e8f5e None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:27.318718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad1db9-716b-46d1-829d-01ec8f8e8f5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:27.319023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad1db9-716b-46d1-829d-01ec8f8e8f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:27.320389 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad1db9-716b-46d1-829d-01ec8f8e8f5e None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:27.329012 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 161/326] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:27.330352 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dddfc-0363-4e39-9e69-e321004cf345 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:27.330638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dddfc-0363-4e39-9e69-e321004cf345 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:27.330913 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dddfc-0363-4e39-9e69-e321004cf345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:27.342908 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 166/327] 10.222.0.52 () {60 vars in 1134 bytes} [Wed Aug 31 14:53:27 2022] POST /identity/v3/groups => generated 226 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 14:53:27.344774 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb031ca4-9abc-4d41-aab1-5faf9943d8d1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:27.350449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-665dddfc-0363-4e39-9e69-e321004cf345 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:27.352121 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-665dddfc-0363-4e39-9e69-e321004cf345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:27.423175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:27.435143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 162/328] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:27.472770 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb031ca4-9abc-4d41-aab1-5faf9943d8d1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:27.510998 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1ba4f-48a1-4a94-8abb-73022bab0da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:27.511641 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1ba4f-48a1-4a94-8abb-73022bab0da1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:27.511919 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1ba4f-48a1-4a94-8abb-73022bab0da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:27.512199 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1ba4f-48a1-4a94-8abb-73022bab0da1 None admin] PATH_INFO: `/v3/users/fb7a5fd6ecdf46d0b5d33d81e5e4fc8d` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:27.513375 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1ba4f-48a1-4a94-8abb-73022bab0da1 None admin] RBAC: Authorizing `identity:get_user(user_id=fb7a5fd6ecdf46d0b5d33d81e5e4fc8d)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:27.514998 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1ba4f-48a1-4a94-8abb-73022bab0da1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:27.516669 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 167/329] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:27 2022] GET /identity/v3/users/fb7a5fd6ecdf46d0b5d33d81e5e4fc8d => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:27.523009 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dddfc-0363-4e39-9e69-e321004cf345 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:27.565314 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:27.632414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dddfc-0363-4e39-9e69-e321004cf345 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:27.670739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aede223-401d-47ab-bc1c-a1ee49969c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:27.671402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede223-401d-47ab-bc1c-a1ee49969c2a None admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:27.671682 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede223-401d-47ab-bc1c-a1ee49969c2a None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:27.671953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aede223-401d-47ab-bc1c-a1ee49969c2a None admin] PATH_INFO: `/v3/system/users/fb7a5fd6ecdf46d0b5d33d81e5e4fc8d/roles/6e5c958fa3a9494db4490551ae5253a9` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:27.675131 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aede223-401d-47ab-bc1c-a1ee49969c2a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fb7a5fd6ecdf46d0b5d33d81e5e4fc8d, role_id=6e5c958fa3a9494db4490551ae5253a9)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:27.676457 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aede223-401d-47ab-bc1c-a1ee49969c2a None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:27.737665 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 163/330] 10.222.0.52 () {58 vars in 1334 bytes} [Wed Aug 31 14:53:27 2022] PUT /identity/v3/system/users/fb7a5fd6ecdf46d0b5d33d81e5e4fc8d/roles/6e5c958fa3a9494db4490551ae5253a9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:53:27.771871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1ba4f-48a1-4a94-8abb-73022bab0da1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:27.894023 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1ba4f-48a1-4a94-8abb-73022bab0da1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:27.927807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:27.934946 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad511bf-0156-4901-b4d9-90aa865635f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:27.935584 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad511bf-0156-4901-b4d9-90aa865635f1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:27.935863 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad511bf-0156-4901-b4d9-90aa865635f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:27.936132 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad511bf-0156-4901-b4d9-90aa865635f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:27.948139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad511bf-0156-4901-b4d9-90aa865635f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-4ad511bf-0156-4901-b4d9-90aa865635f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:27.954877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:27.955951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:27.956746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 168/331] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:27.960129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aede223-401d-47ab-bc1c-a1ee49969c2a None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:28.080718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aede223-401d-47ab-bc1c-a1ee49969c2a None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:28.082286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:28.118363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff5dc-e483-43a8-a40b-de02f89890fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:28.119072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff5dc-e483-43a8-a40b-de02f89890fb None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:28.119352 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff5dc-e483-43a8-a40b-de02f89890fb None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:28.119625 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff5dc-e483-43a8-a40b-de02f89890fb None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:28.120292 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ff5dc-e483-43a8-a40b-de02f89890fb None admin] RBAC: Adding query filter params (name=member) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:28.120590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ff5dc-e483-43a8-a40b-de02f89890fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:28.121974 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ff5dc-e483-43a8-a40b-de02f89890fb None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:28.131691 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 164/332] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:28.137824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad511bf-0156-4901-b4d9-90aa865635f1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:28.256768 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad511bf-0156-4901-b4d9-90aa865635f1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:28.295258 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312506f-115f-4546-851d-a3882ec58bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:28.295894 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312506f-115f-4546-851d-a3882ec58bf2 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:28.296179 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312506f-115f-4546-851d-a3882ec58bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:28.296451 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312506f-115f-4546-851d-a3882ec58bf2 None admin] PATH_INFO: `/v3/users/efab5e7d9e5945588430151ddfe52d6b` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:28.297605 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312506f-115f-4546-851d-a3882ec58bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=efab5e7d9e5945588430151ddfe52d6b)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:28.299105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312506f-115f-4546-851d-a3882ec58bf2 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:28.301059 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 169/333] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:28 2022] GET /identity/v3/users/efab5e7d9e5945588430151ddfe52d6b => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:28.307277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff5dc-e483-43a8-a40b-de02f89890fb None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:28.480534 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff5dc-e483-43a8-a40b-de02f89890fb None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:28.535095 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c993a96-65ab-4d56-abc6-86b1a6ccbea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:28.535679 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c993a96-65ab-4d56-abc6-86b1a6ccbea1 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:28.535904 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c993a96-65ab-4d56-abc6-86b1a6ccbea1 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:28.536158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c993a96-65ab-4d56-abc6-86b1a6ccbea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:28.536883 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c993a96-65ab-4d56-abc6-86b1a6ccbea1 None admin] RBAC: Adding query filter params (role.id=807b71faee4a435e95e2ca3296e64c2e, user.id=efab5e7d9e5945588430151ddfe52d6b, scope.system=all) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:28.537187 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c993a96-65ab-4d56-abc6-86b1a6ccbea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:28.538629 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c993a96-65ab-4d56-abc6-86b1a6ccbea1 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:28.552229 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 165/334] 10.222.0.52 () {56 vars in 1308 bytes} [Wed Aug 31 14:53:28 2022] GET /identity/v3/role_assignments?user.id=efab5e7d9e5945588430151ddfe52d6b&scope.system=all&role.id=807b71faee4a435e95e2ca3296e64c2e => generated 510 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:29.990719 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a38d-290b-4c2a-9b03-24ed4ef126df None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:29.991225 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a38d-290b-4c2a-9b03-24ed4ef126df None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:29.991298 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a38d-290b-4c2a-9b03-24ed4ef126df None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:29.993869 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 170/335] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:29.998919 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95f8b4-eee0-4aed-9f71-d91b3af840d7 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:29.999402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95f8b4-eee0-4aed-9f71-d91b3af840d7 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:29.999674 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95f8b4-eee0-4aed-9f71-d91b3af840d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:30.030423 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-ac95f8b4-eee0-4aed-9f71-d91b3af840d7 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:30.031627 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-ac95f8b4-eee0-4aed-9f71-d91b3af840d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:30.056726 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:30.121265 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 166/336] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:30.781744 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19a38d-290b-4c2a-9b03-24ed4ef126df None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:30.866975 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:30.925820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b73146-84f0-4a9b-bf1a-19cd6dc3a5a1 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:30.926149 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b73146-84f0-4a9b-bf1a-19cd6dc3a5a1 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:30.926394 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b73146-84f0-4a9b-bf1a-19cd6dc3a5a1 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:30.927728 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 167/337] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:53:30.935027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442fbc-a256-435e-a7fc-f7251024cf3f None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:30.935307 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442fbc-a256-435e-a7fc-f7251024cf3f None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:30.935586 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442fbc-a256-435e-a7fc-f7251024cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:30.951802 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19a38d-290b-4c2a-9b03-24ed4ef126df None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:30.958982 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-68442fbc-a256-435e-a7fc-f7251024cf3f None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:30.960691 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-68442fbc-a256-435e-a7fc-f7251024cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:31.046806 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 168/338] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 14:53:31.047756 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2842971-3f57-4240-8273-53a00dbdec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:31.048263 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a28e-c7d3-4ad1-a744-c31d2ea615b7 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:31.048462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2842971-3f57-4240-8273-53a00dbdec27 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:31.048562 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a28e-c7d3-4ad1-a744-c31d2ea615b7 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:31.048750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2842971-3f57-4240-8273-53a00dbdec27 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:31.048848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a28e-c7d3-4ad1-a744-c31d2ea615b7 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:31.049018 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2842971-3f57-4240-8273-53a00dbdec27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:31.050172 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 169/339] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:31.057030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9f323-460c-432d-ad03-898bf36f8413 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:31.057308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9f323-460c-432d-ad03-898bf36f8413 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:31.060395 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9f323-460c-432d-ad03-898bf36f8413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:31.074944 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2842971-3f57-4240-8273-53a00dbdec27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-d2842971-3f57-4240-8273-53a00dbdec27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:31.080423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:31.081317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:31.082617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 171/340] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:31.085428 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-65b9f323-460c-432d-ad03-898bf36f8413 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:31.086688 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-65b9f323-460c-432d-ad03-898bf36f8413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:31.095802 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76677ac2-d7b2-4f6e-9719-2a1b8c69ce05 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:31.096063 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76677ac2-d7b2-4f6e-9719-2a1b8c69ce05 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:31.096345 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76677ac2-d7b2-4f6e-9719-2a1b8c69ce05 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:31.097675 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 172/341] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:31.098391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76677ac2-d7b2-4f6e-9719-2a1b8c69ce05 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:31.180516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 170/342] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:31.183138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a311e-7636-4756-a38c-b99c0c3e867c None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:31.183423 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a311e-7636-4756-a38c-b99c0c3e867c None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:31.183693 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a311e-7636-4756-a38c-b99c0c3e867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:31.209965 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-4e2a311e-7636-4756-a38c-b99c0c3e867c None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:31.212143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-4e2a311e-7636-4756-a38c-b99c0c3e867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:31.225062 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:31.323886 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 171/343] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:31.339947 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76677ac2-d7b2-4f6e-9719-2a1b8c69ce05 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:31.362410 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:31.385938 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802d3d8-a847-43c4-846d-e6fc0aa9a98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:31.386582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802d3d8-a847-43c4-846d-e6fc0aa9a98f None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:31.386863 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802d3d8-a847-43c4-846d-e6fc0aa9a98f None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:31.387133 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802d3d8-a847-43c4-846d-e6fc0aa9a98f None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:31.387800 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802d3d8-a847-43c4-846d-e6fc0aa9a98f None admin] RBAC: Adding query filter params (name=member) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:31.388104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802d3d8-a847-43c4-846d-e6fc0aa9a98f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:31.389535 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802d3d8-a847-43c4-846d-e6fc0aa9a98f None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:31.406707 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 173/344] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:31.413022 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a311e-7636-4756-a38c-b99c0c3e867c None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:31.545725 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a311e-7636-4756-a38c-b99c0c3e867c None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:31.585397 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21277aa-40ec-4592-8c8f-a27dc3680f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:31.586415 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21277aa-40ec-4592-8c8f-a27dc3680f34 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:31.587078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21277aa-40ec-4592-8c8f-a27dc3680f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:31.587539 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21277aa-40ec-4592-8c8f-a27dc3680f34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:31.604110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:31.666965 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21277aa-40ec-4592-8c8f-a27dc3680f34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:31.668402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21277aa-40ec-4592-8c8f-a27dc3680f34 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:31.779582 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 172/345] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:31.785317 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802d3d8-a847-43c4-846d-e6fc0aa9a98f None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:31.803957 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21277aa-40ec-4592-8c8f-a27dc3680f34 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:31.878134 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:31.957763 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802d3d8-a847-43c4-846d-e6fc0aa9a98f None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:31.974565 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21277aa-40ec-4592-8c8f-a27dc3680f34 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:32.009430 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178355-09ac-4bb9-96e4-fd32f7fd767a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:32.010390 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178355-09ac-4bb9-96e4-fd32f7fd767a None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:32.010857 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178355-09ac-4bb9-96e4-fd32f7fd767a None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:32.011263 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178355-09ac-4bb9-96e4-fd32f7fd767a None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:32.012624 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1178355-09ac-4bb9-96e4-fd32f7fd767a None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:32.015923 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1178355-09ac-4bb9-96e4-fd32f7fd767a None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:32.016051 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887708e0-38d4-4ca1-8fd4-84cc04ef8c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:32.016506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887708e0-38d4-4ca1-8fd4-84cc04ef8c9f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:32.016787 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887708e0-38d4-4ca1-8fd4-84cc04ef8c9f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:32.017054 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887708e0-38d4-4ca1-8fd4-84cc04ef8c9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:32.018406 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 174/346] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:31 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:32.019314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178355-09ac-4bb9-96e4-fd32f7fd767a None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:32.038181 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887708e0-38d4-4ca1-8fd4-84cc04ef8c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-887708e0-38d4-4ca1-8fd4-84cc04ef8c9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:32.046761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:32.048248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:32.049067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:32.049067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:32.049067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:32.049067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:32.049067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:32.049067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:32.049067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:32.049067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:32.049067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:32.049067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:32.049067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 14:53:32.049067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:32.051814 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 173/347] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:32.052858 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887708e0-38d4-4ca1-8fd4-84cc04ef8c9f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:32.089134 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:32.157208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178355-09ac-4bb9-96e4-fd32f7fd767a None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:32.193808 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887708e0-38d4-4ca1-8fd4-84cc04ef8c9f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:32.197141 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:32.203395 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb70536-3075-4c89-a15f-f475573d0096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:32.204119 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb70536-3075-4c89-a15f-f475573d0096 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:32.204486 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb70536-3075-4c89-a15f-f475573d0096 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:32.204813 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb70536-3075-4c89-a15f-f475573d0096 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:32.217541 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb70536-3075-4c89-a15f-f475573d0096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-efb70536-3075-4c89-a15f-f475573d0096 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:32.222686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:32.223796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:32.224826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:32.224826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:32.224826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:32.224826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:32.224826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:32.224826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:32.224826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:32.224826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:32.224826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:32.224826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:32.224826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:32.224826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:32.226894 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 175/348] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:53:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:32.227869 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb70536-3075-4c89-a15f-f475573d0096 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:32.245577 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942c01-46b3-4224-946a-3aeb0f27a720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:32.246334 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942c01-46b3-4224-946a-3aeb0f27a720 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:32.246674 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942c01-46b3-4224-946a-3aeb0f27a720 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:32.246947 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942c01-46b3-4224-946a-3aeb0f27a720 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:32.260868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f942c01-46b3-4224-946a-3aeb0f27a720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-0f942c01-46b3-4224-946a-3aeb0f27a720 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:32.266070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:32.267057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:32.268319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 174/349] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:32.269184 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942c01-46b3-4224-946a-3aeb0f27a720 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:32.364190 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb70536-3075-4c89-a15f-f475573d0096 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:32.376167 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:32.399269 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942c01-46b3-4224-946a-3aeb0f27a720 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:32.407157 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e353dd-cc86-43f3-a2bf-8a54546afec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:32.407838 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e353dd-cc86-43f3-a2bf-8a54546afec7 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:32.408063 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e353dd-cc86-43f3-a2bf-8a54546afec7 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:32.408326 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e353dd-cc86-43f3-a2bf-8a54546afec7 None admin] PATH_INFO: `/v3/groups/d386962cc5c342bb80fc641fdbb71f37` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:32.418281 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e353dd-cc86-43f3-a2bf-8a54546afec7 None admin] RBAC: Authorizing `identity:get_group(group_id=d386962cc5c342bb80fc641fdbb71f37)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:32.419794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e353dd-cc86-43f3-a2bf-8a54546afec7 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:32.421964 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 176/350] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:32 2022] GET /identity/v3/groups/d386962cc5c342bb80fc641fdbb71f37 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:32.423162 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e19f3b-5fa5-4aad-8c36-ccf98579d426 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:32.423451 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e19f3b-5fa5-4aad-8c36-ccf98579d426 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:32.423722 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e19f3b-5fa5-4aad-8c36-ccf98579d426 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:32.425030 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 177/351] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:32.425560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e19f3b-5fa5-4aad-8c36-ccf98579d426 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:32.446415 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05507d0a-024b-41d7-accf-c7d8d9342074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:32.447032 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507d0a-024b-41d7-accf-c7d8d9342074 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:32.447308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507d0a-024b-41d7-accf-c7d8d9342074 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:32.447579 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507d0a-024b-41d7-accf-c7d8d9342074 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:32.448241 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05507d0a-024b-41d7-accf-c7d8d9342074 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:32.448541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05507d0a-024b-41d7-accf-c7d8d9342074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:32.449893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05507d0a-024b-41d7-accf-c7d8d9342074 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:32.458477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 175/352] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:32.459283 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05507d0a-024b-41d7-accf-c7d8d9342074 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:32.499524 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:32.573698 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e19f3b-5fa5-4aad-8c36-ccf98579d426 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:32.600567 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05507d0a-024b-41d7-accf-c7d8d9342074 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:32.620194 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1d354-e95d-4892-8511-5c1ddabd5626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:32.620817 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1d354-e95d-4892-8511-5c1ddabd5626 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:32.621093 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1d354-e95d-4892-8511-5c1ddabd5626 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:32.621363 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1d354-e95d-4892-8511-5c1ddabd5626 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:32.622022 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1d354-e95d-4892-8511-5c1ddabd5626 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:32.623450 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1d354-e95d-4892-8511-5c1ddabd5626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:32.624867 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1d354-e95d-4892-8511-5c1ddabd5626 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:32.635925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 178/353] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:32.637150 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8434ef0-471a-4944-a3cb-3caa731d4d7f None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:32.637860 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8434ef0-471a-4944-a3cb-3caa731d4d7f None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:32.637860 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8434ef0-471a-4944-a3cb-3caa731d4d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:32.651159 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffa0f8-4a90-496b-9251-d5bb897ad78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:32.655487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffa0f8-4a90-496b-9251-d5bb897ad78b None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:32.655487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffa0f8-4a90-496b-9251-d5bb897ad78b None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:32.655487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffa0f8-4a90-496b-9251-d5bb897ad78b None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:32.655487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffa0f8-4a90-496b-9251-d5bb897ad78b None admin] RBAC: Adding query filter params (name=member) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:32.655487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffa0f8-4a90-496b-9251-d5bb897ad78b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:32.655851 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffa0f8-4a90-496b-9251-d5bb897ad78b None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:32.662424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-a8434ef0-471a-4944-a3cb-3caa731d4d7f None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:32.663566 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-a8434ef0-471a-4944-a3cb-3caa731d4d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:32.667553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 176/354] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:32.668649 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffa0f8-4a90-496b-9251-d5bb897ad78b None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:32.698480 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:32.751036 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 179/355] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:32.751714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8434ef0-471a-4944-a3cb-3caa731d4d7f None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:32.789125 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:32.808986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffa0f8-4a90-496b-9251-d5bb897ad78b None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:32.861716 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b98b76-9d79-40cd-afd7-e126f2d3808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:32.865311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b98b76-9d79-40cd-afd7-e126f2d3808f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:32.865311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b98b76-9d79-40cd-afd7-e126f2d3808f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:32.865311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b98b76-9d79-40cd-afd7-e126f2d3808f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:32.865311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b98b76-9d79-40cd-afd7-e126f2d3808f None admin] RBAC: Adding query filter params (group.id=d386962cc5c342bb80fc641fdbb71f37, role.id=807b71faee4a435e95e2ca3296e64c2e, scope.project.id=45e07b89720a4d87bfe2ca7a011f0871) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:32.865311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b98b76-9d79-40cd-afd7-e126f2d3808f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:32.865995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b98b76-9d79-40cd-afd7-e126f2d3808f None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:32.873869 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 177/356] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 31 14:53:32 2022] GET /identity/v3/role_assignments?group.id=d386962cc5c342bb80fc641fdbb71f37&scope.project.id=45e07b89720a4d87bfe2ca7a011f0871&role.id=807b71faee4a435e95e2ca3296e64c2e => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:32.877172 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b98b76-9d79-40cd-afd7-e126f2d3808f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:32.886190 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8434ef0-471a-4944-a3cb-3caa731d4d7f None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:32.929669 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb2260-d37f-4bd2-b391-bf82a532a37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:32.931277 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb2260-d37f-4bd2-b391-bf82a532a37d None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:32.931779 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb2260-d37f-4bd2-b391-bf82a532a37d None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:32.932335 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb2260-d37f-4bd2-b391-bf82a532a37d None admin] PATH_INFO: `/v3/users/fb7a5fd6ecdf46d0b5d33d81e5e4fc8d` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:32.933930 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb2260-d37f-4bd2-b391-bf82a532a37d None admin] RBAC: Authorizing `identity:get_user(user_id=fb7a5fd6ecdf46d0b5d33d81e5e4fc8d)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:32.935762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb2260-d37f-4bd2-b391-bf82a532a37d None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:32.938132 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 180/357] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 31 14:53:32 2022] GET /identity/v3/users/fb7a5fd6ecdf46d0b5d33d81e5e4fc8d => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:32.939269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb2260-d37f-4bd2-b391-bf82a532a37d None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:32.976658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:33.012635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b98b76-9d79-40cd-afd7-e126f2d3808f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:33.053187 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba7930-c125-443b-a7a8-4465ad92caf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:33.053850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba7930-c125-443b-a7a8-4465ad92caf1 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:33.054132 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba7930-c125-443b-a7a8-4465ad92caf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:33.054448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba7930-c125-443b-a7a8-4465ad92caf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:33.076179 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb2260-d37f-4bd2-b391-bf82a532a37d None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:33.077592 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:33.123657 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c58c42-d191-44f1-b564-51d747202ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:33.124386 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c58c42-d191-44f1-b564-51d747202ba7 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:33.124668 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c58c42-d191-44f1-b564-51d747202ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:33.124940 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c58c42-d191-44f1-b564-51d747202ba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:33.140924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba7930-c125-443b-a7a8-4465ad92caf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:33.142532 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba7930-c125-443b-a7a8-4465ad92caf1 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:33.213245 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c58c42-d191-44f1-b564-51d747202ba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:33.214884 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c58c42-d191-44f1-b564-51d747202ba7 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:33.253816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:33.269207 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 178/358] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:33.270517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eebc8-ab77-4799-81d5-112c8391d554 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:33.270878 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eebc8-ab77-4799-81d5-112c8391d554 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:33.271275 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eebc8-ab77-4799-81d5-112c8391d554 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:33.272729 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 179/359] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:33.273562 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eebc8-ab77-4799-81d5-112c8391d554 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:33.345248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:33.350487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 181/360] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:33.351332 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c58c42-d191-44f1-b564-51d747202ba7 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:33.418364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eebc8-ab77-4799-81d5-112c8391d554 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:33.466108 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc62e8-6b3e-4e42-a6c2-2f715ad92bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:33.466699 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc62e8-6b3e-4e42-a6c2-2f715ad92bcf None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:33.466981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc62e8-6b3e-4e42-a6c2-2f715ad92bcf None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:33.467258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc62e8-6b3e-4e42-a6c2-2f715ad92bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:33.467991 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc62e8-6b3e-4e42-a6c2-2f715ad92bcf None admin] RBAC: Adding query filter params (role.id=6e5c958fa3a9494db4490551ae5253a9, user.id=fb7a5fd6ecdf46d0b5d33d81e5e4fc8d, scope.system=all) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:33.468306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc62e8-6b3e-4e42-a6c2-2f715ad92bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:33.469747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc62e8-6b3e-4e42-a6c2-2f715ad92bcf None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:33.481811 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c58c42-d191-44f1-b564-51d747202ba7 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:33.490143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 180/361] 10.222.0.52 () {56 vars in 1308 bytes} [Wed Aug 31 14:53:33 2022] GET /identity/v3/role_assignments?user.id=fb7a5fd6ecdf46d0b5d33d81e5e4fc8d&scope.system=all&role.id=6e5c958fa3a9494db4490551ae5253a9 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:33.491763 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839a35c-ee39-458a-8f2e-4e481892d506 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:33.492240 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839a35c-ee39-458a-8f2e-4e481892d506 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:33.493104 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839a35c-ee39-458a-8f2e-4e481892d506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:33.517892 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-9839a35c-ee39-458a-8f2e-4e481892d506 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:33.519805 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-9839a35c-ee39-458a-8f2e-4e481892d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:33.522900 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54130454-49f0-41eb-861b-3e97c4ac9a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:33.524284 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54130454-49f0-41eb-861b-3e97c4ac9a86 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:33.524630 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54130454-49f0-41eb-861b-3e97c4ac9a86 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:33.525007 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54130454-49f0-41eb-861b-3e97c4ac9a86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:33.531302 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:33.543657 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54130454-49f0-41eb-861b-3e97c4ac9a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-54130454-49f0-41eb-861b-3e97c4ac9a86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:33.550896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:33.551844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:33.552703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:33.552703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:33.552703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:33.552703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:33.552703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:33.552703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:33.552703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:33.552703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:33.552703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:33.552703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:33.552703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:33.552703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:33.555861 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 182/362] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:53:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:33.556967 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54130454-49f0-41eb-861b-3e97c4ac9a86 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:33.619749 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 181/363] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:33.620603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839a35c-ee39-458a-8f2e-4e481892d506 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:33.692851 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54130454-49f0-41eb-861b-3e97c4ac9a86 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:33.715038 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:33.734660 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248e0e4-45f4-47fc-9e69-9726faeb2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:33.735611 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e0e4-45f4-47fc-9e69-9726faeb2697 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:33.736576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e0e4-45f4-47fc-9e69-9726faeb2697 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:33.737072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e0e4-45f4-47fc-9e69-9726faeb2697 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:33.739656 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248e0e4-45f4-47fc-9e69-9726faeb2697 None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:33.741832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248e0e4-45f4-47fc-9e69-9726faeb2697 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:33.744873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 183/364] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:33 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:33.745869 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248e0e4-45f4-47fc-9e69-9726faeb2697 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:33.807716 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839a35c-ee39-458a-8f2e-4e481892d506 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:33.850737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:33.855195 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752b657-7709-4644-bd6b-e8321df90bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:33.855195 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752b657-7709-4644-bd6b-e8321df90bf0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:33.855392 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752b657-7709-4644-bd6b-e8321df90bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:33.855746 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752b657-7709-4644-bd6b-e8321df90bf0 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:33.856859 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752b657-7709-4644-bd6b-e8321df90bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:33.859451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752b657-7709-4644-bd6b-e8321df90bf0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:33.862018 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 182/365] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:33 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:33.862018 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752b657-7709-4644-bd6b-e8321df90bf0 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:33.905643 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248e0e4-45f4-47fc-9e69-9726faeb2697 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:33.946156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183be4b-993a-4e86-ba62-97496edcb75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:33.947100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183be4b-993a-4e86-ba62-97496edcb75d None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:33.947477 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183be4b-993a-4e86-ba62-97496edcb75d None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:33.948632 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183be4b-993a-4e86-ba62-97496edcb75d None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:33.949484 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183be4b-993a-4e86-ba62-97496edcb75d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:33.949839 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183be4b-993a-4e86-ba62-97496edcb75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:33.951319 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183be4b-993a-4e86-ba62-97496edcb75d None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:33.962932 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 184/366] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:33.963907 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183be4b-993a-4e86-ba62-97496edcb75d None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:33.990774 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752b657-7709-4644-bd6b-e8321df90bf0 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:34.002878 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:34.040582 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba42512-7cc6-4517-bdb0-63d63bbd545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:34.041213 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42512-7cc6-4517-bdb0-63d63bbd545d None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:34.041488 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42512-7cc6-4517-bdb0-63d63bbd545d None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:34.041755 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42512-7cc6-4517-bdb0-63d63bbd545d None admin] PATH_INFO: `/v3/groups/d386962cc5c342bb80fc641fdbb71f37` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:34.042903 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba42512-7cc6-4517-bdb0-63d63bbd545d None admin] RBAC: Authorizing `identity:get_group(group_id=d386962cc5c342bb80fc641fdbb71f37)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:34.044322 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba42512-7cc6-4517-bdb0-63d63bbd545d None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:34.050749 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 183/367] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:33 2022] GET /identity/v3/groups/d386962cc5c342bb80fc641fdbb71f37 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:34.051636 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba42512-7cc6-4517-bdb0-63d63bbd545d None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:34.102859 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183be4b-993a-4e86-ba62-97496edcb75d None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:34.130763 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:34.144697 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389fc9f-d2a5-4dda-a476-42b8654c33ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:34.145439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389fc9f-d2a5-4dda-a476-42b8654c33ec None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:34.145720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389fc9f-d2a5-4dda-a476-42b8654c33ec None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:34.145993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389fc9f-d2a5-4dda-a476-42b8654c33ec None admin] PATH_INFO: `/v3/groups/d386962cc5c342bb80fc641fdbb71f37` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:34.147795 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389fc9f-d2a5-4dda-a476-42b8654c33ec None admin] RBAC: Authorizing `identity:get_group(group_id=d386962cc5c342bb80fc641fdbb71f37)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:34.149182 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389fc9f-d2a5-4dda-a476-42b8654c33ec None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:34.152044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 185/368] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:33 2022] GET /identity/v3/groups/d386962cc5c342bb80fc641fdbb71f37 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:34.154501 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389fc9f-d2a5-4dda-a476-42b8654c33ec None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:34.194248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba42512-7cc6-4517-bdb0-63d63bbd545d None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:34.240039 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92f15e-5d39-48a4-b21d-b8f884fedd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:34.241008 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92f15e-5d39-48a4-b21d-b8f884fedd2e None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:34.241500 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92f15e-5d39-48a4-b21d-b8f884fedd2e None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:34.241775 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92f15e-5d39-48a4-b21d-b8f884fedd2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:34.291734 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389fc9f-d2a5-4dda-a476-42b8654c33ec None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:34.302119 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:34.332695 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd49b06-bf7d-4b35-8882-abf20eb7a23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:34.333314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd49b06-bf7d-4b35-8882-abf20eb7a23e None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:34.333595 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd49b06-bf7d-4b35-8882-abf20eb7a23e None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:34.333871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd49b06-bf7d-4b35-8882-abf20eb7a23e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:34.334101 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92f15e-5d39-48a4-b21d-b8f884fedd2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:34.334643 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd49b06-bf7d-4b35-8882-abf20eb7a23e None admin] RBAC: Adding query filter params (group.id=d386962cc5c342bb80fc641fdbb71f37, role.id=a3a5839e9bda47d8af7a7b707f7a9888, scope.project.id=45e07b89720a4d87bfe2ca7a011f0871) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:34.334952 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd49b06-bf7d-4b35-8882-abf20eb7a23e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:34.335585 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92f15e-5d39-48a4-b21d-b8f884fedd2e None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:34.336416 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd49b06-bf7d-4b35-8882-abf20eb7a23e None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:34.343166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 186/369] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 31 14:53:34 2022] GET /identity/v3/role_assignments?group.id=d386962cc5c342bb80fc641fdbb71f37&scope.project.id=45e07b89720a4d87bfe2ca7a011f0871&role.id=a3a5839e9bda47d8af7a7b707f7a9888 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:34.344858 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd49b06-bf7d-4b35-8882-abf20eb7a23e None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:34.429065 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:34.482201 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 184/370] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:34.483685 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92f15e-5d39-48a4-b21d-b8f884fedd2e None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:34.510844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd49b06-bf7d-4b35-8882-abf20eb7a23e None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:34.563697 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207b5e8-c5a4-4500-92a6-fabb8ae7755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:34.564344 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b5e8-c5a4-4500-92a6-fabb8ae7755c None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:34.564631 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b5e8-c5a4-4500-92a6-fabb8ae7755c None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:34.564912 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b5e8-c5a4-4500-92a6-fabb8ae7755c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:34.577783 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:34.582988 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207b5e8-c5a4-4500-92a6-fabb8ae7755c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-4207b5e8-c5a4-4500-92a6-fabb8ae7755c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:34.588996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:34.595127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 187/371] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:53:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:34.596038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207b5e8-c5a4-4500-92a6-fabb8ae7755c None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:34.614531 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92f15e-5d39-48a4-b21d-b8f884fedd2e None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:34.662527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa8ea9-4053-4144-8a87-c03b7cc05538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:34.663288 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa8ea9-4053-4144-8a87-c03b7cc05538 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:34.663698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa8ea9-4053-4144-8a87-c03b7cc05538 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:34.663980 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa8ea9-4053-4144-8a87-c03b7cc05538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:34.665002 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa8ea9-4053-4144-8a87-c03b7cc05538 None admin] RBAC: Adding query filter params (group.id=d386962cc5c342bb80fc641fdbb71f37, role.id=807b71faee4a435e95e2ca3296e64c2e, scope.project.id=a37fe08aba474a1bb58912f977979b86) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:34.665296 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa8ea9-4053-4144-8a87-c03b7cc05538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:34.667528 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa8ea9-4053-4144-8a87-c03b7cc05538 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:34.674919 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 185/372] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 31 14:53:34 2022] GET /identity/v3/role_assignments?group.id=d386962cc5c342bb80fc641fdbb71f37&scope.project.id=a37fe08aba474a1bb58912f977979b86&role.id=807b71faee4a435e95e2ca3296e64c2e => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:34.675762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa8ea9-4053-4144-8a87-c03b7cc05538 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:34.741063 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207b5e8-c5a4-4500-92a6-fabb8ae7755c None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:34.770156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:34.817210 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbf322-d76f-42c1-affe-78f16ffa69e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:34.817864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf322-d76f-42c1-affe-78f16ffa69e3 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:34.818149 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf322-d76f-42c1-affe-78f16ffa69e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:34.818468 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf322-d76f-42c1-affe-78f16ffa69e3 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:34.823145 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbf322-d76f-42c1-affe-78f16ffa69e3 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:34.824668 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbf322-d76f-42c1-affe-78f16ffa69e3 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:34.830321 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 188/373] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:34 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:34.832984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbf322-d76f-42c1-affe-78f16ffa69e3 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:34.891937 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa8ea9-4053-4144-8a87-c03b7cc05538 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:34.931280 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff68bb1-9594-4697-9163-f700ced1f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:34.931977 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff68bb1-9594-4697-9163-f700ced1f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:34.932253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff68bb1-9594-4697-9163-f700ced1f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:34.932521 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff68bb1-9594-4697-9163-f700ced1f3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:34.933193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff68bb1-9594-4697-9163-f700ced1f3b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:34.933499 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff68bb1-9594-4697-9163-f700ced1f3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:34.937328 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff68bb1-9594-4697-9163-f700ced1f3b6 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:34.947365 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:34.948804 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 186/374] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:34.953693 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff68bb1-9594-4697-9163-f700ced1f3b6 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:35.019643 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbf322-d76f-42c1-affe-78f16ffa69e3 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:35.077810 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f281c-ed0b-4b34-98f1-5dde00304abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:35.078386 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f281c-ed0b-4b34-98f1-5dde00304abf None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:35.078668 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f281c-ed0b-4b34-98f1-5dde00304abf None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:35.078939 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f281c-ed0b-4b34-98f1-5dde00304abf None admin] PATH_INFO: `/v3/groups/d386962cc5c342bb80fc641fdbb71f37` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:35.082399 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f281c-ed0b-4b34-98f1-5dde00304abf None admin] RBAC: Authorizing `identity:get_group(group_id=d386962cc5c342bb80fc641fdbb71f37)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:35.083864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f281c-ed0b-4b34-98f1-5dde00304abf None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:35.088022 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 189/375] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:34 2022] GET /identity/v3/groups/d386962cc5c342bb80fc641fdbb71f37 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:35.092563 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f281c-ed0b-4b34-98f1-5dde00304abf None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:35.149725 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff68bb1-9594-4697-9163-f700ced1f3b6 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:35.182267 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:35.224193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58050381-7f91-4458-97f1-3badbe717600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:35.225496 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58050381-7f91-4458-97f1-3badbe717600 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:35.225973 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58050381-7f91-4458-97f1-3badbe717600 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:35.226506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58050381-7f91-4458-97f1-3badbe717600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:35.241113 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f281c-ed0b-4b34-98f1-5dde00304abf None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:35.282321 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af712068-9d1e-4854-8538-1457b542dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:35.282321 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712068-9d1e-4854-8538-1457b542dc44 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:35.282321 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712068-9d1e-4854-8538-1457b542dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:35.282321 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712068-9d1e-4854-8538-1457b542dc44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:35.282740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af712068-9d1e-4854-8538-1457b542dc44 None admin] RBAC: Adding query filter params (group.id=d386962cc5c342bb80fc641fdbb71f37, role.id=a3a5839e9bda47d8af7a7b707f7a9888, scope.project.id=a37fe08aba474a1bb58912f977979b86) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:35.282740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af712068-9d1e-4854-8538-1457b542dc44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:35.282740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af712068-9d1e-4854-8538-1457b542dc44 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:35.289098 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 190/376] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 31 14:53:35 2022] GET /identity/v3/role_assignments?group.id=d386962cc5c342bb80fc641fdbb71f37&scope.project.id=a37fe08aba474a1bb58912f977979b86&role.id=a3a5839e9bda47d8af7a7b707f7a9888 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:35.347208 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:35.350244 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58050381-7f91-4458-97f1-3badbe717600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:35.351773 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58050381-7f91-4458-97f1-3badbe717600 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:35.491698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 187/377] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 14:53:35.495778 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8931701-8d8f-4657-b8ec-4febcdd2d944 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:35.496058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8931701-8d8f-4657-b8ec-4febcdd2d944 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:35.496334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8931701-8d8f-4657-b8ec-4febcdd2d944 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:35.497666 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 191/378] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:35.498371 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58050381-7f91-4458-97f1-3badbe717600 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:35.512167 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc58c9-6e5d-4384-a971-5adc73db9b28 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:35.512446 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc58c9-6e5d-4384-a971-5adc73db9b28 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:35.512721 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc58c9-6e5d-4384-a971-5adc73db9b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:35.553609 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-cfcc58c9-6e5d-4384-a971-5adc73db9b28 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:35.554810 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-cfcc58c9-6e5d-4384-a971-5adc73db9b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:35.614859 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:35.618214 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58050381-7f91-4458-97f1-3badbe717600 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:35.655793 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 192/379] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:35.656086 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33291d7e-f675-411d-b0e1-f6a824627de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:35.656659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33291d7e-f675-411d-b0e1-f6a824627de0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:35.656938 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33291d7e-f675-411d-b0e1-f6a824627de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:35.657210 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33291d7e-f675-411d-b0e1-f6a824627de0 None admin] PATH_INFO: `/v3/projects/b905fa215ef84f989a1edb29db9488aa` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:35.659270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33291d7e-f675-411d-b0e1-f6a824627de0 None admin] RBAC: Authorizing `identity:get_project(project_id=b905fa215ef84f989a1edb29db9488aa)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:35.659914 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33291d7e-f675-411d-b0e1-f6a824627de0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:35.664289 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 188/380] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:35 2022] GET /identity/v3/projects/b905fa215ef84f989a1edb29db9488aa => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:35.668714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc58c9-6e5d-4384-a971-5adc73db9b28 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:35.727665 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:35.783808 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc58c9-6e5d-4384-a971-5adc73db9b28 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:35.824622 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0b1df-a8bd-4bd6-8200-31f1e9929d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:35.825262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0b1df-a8bd-4bd6-8200-31f1e9929d6a None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:35.825546 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0b1df-a8bd-4bd6-8200-31f1e9929d6a None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:35.825818 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0b1df-a8bd-4bd6-8200-31f1e9929d6a None admin] PATH_INFO: `/v3/groups/fb2d751aa55d4caea12b2f6eb256eafc` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:35.830805 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0b1df-a8bd-4bd6-8200-31f1e9929d6a None admin] RBAC: Authorizing `identity:get_group(group_id=fb2d751aa55d4caea12b2f6eb256eafc)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:35.832291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0b1df-a8bd-4bd6-8200-31f1e9929d6a None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:35.837597 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 193/381] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:35 2022] GET /identity/v3/groups/fb2d751aa55d4caea12b2f6eb256eafc => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:35.843252 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33291d7e-f675-411d-b0e1-f6a824627de0 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:35.983345 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33291d7e-f675-411d-b0e1-f6a824627de0 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:36.026012 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9be6-c6b5-4b62-b696-db6ba0e9786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:36.026923 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9be6-c6b5-4b62-b696-db6ba0e9786f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:36.027339 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9be6-c6b5-4b62-b696-db6ba0e9786f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:36.027805 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9be6-c6b5-4b62-b696-db6ba0e9786f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:36.028669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c9be6-c6b5-4b62-b696-db6ba0e9786f None admin] RBAC: Adding query filter params (group.id=fb2d751aa55d4caea12b2f6eb256eafc, role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4, scope.project.id=b905fa215ef84f989a1edb29db9488aa) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:36.029138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c9be6-c6b5-4b62-b696-db6ba0e9786f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:36.030721 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c9be6-c6b5-4b62-b696-db6ba0e9786f None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:36.042210 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 189/382] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 31 14:53:35 2022] GET /identity/v3/role_assignments?group.id=fb2d751aa55d4caea12b2f6eb256eafc&scope.project.id=b905fa215ef84f989a1edb29db9488aa&role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:36.376612 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0b1df-a8bd-4bd6-8200-31f1e9929d6a None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:36.497524 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0b1df-a8bd-4bd6-8200-31f1e9929d6a None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:36.516366 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:36.548687 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae7bf-39aa-4679-b387-0ad8db30f379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:36.549554 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae7bf-39aa-4679-b387-0ad8db30f379 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:36.549973 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae7bf-39aa-4679-b387-0ad8db30f379 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:36.554561 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae7bf-39aa-4679-b387-0ad8db30f379 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:36.571658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ae7bf-39aa-4679-b387-0ad8db30f379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-bf2ae7bf-39aa-4679-b387-0ad8db30f379 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:36.576737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:36.577893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:36.578905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:36.578905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:36.578905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:36.578905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:36.578905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:36.578905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:36.578905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:36.578905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:36.578905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:36.578905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:36.578905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:36.578905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:36.581151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 194/383] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:36.587258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9be6-c6b5-4b62-b696-db6ba0e9786f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:36.628213 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:36.736619 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9be6-c6b5-4b62-b696-db6ba0e9786f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:36.785332 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29472-cc88-4985-94b8-07d7f1231290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:36.785972 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29472-cc88-4985-94b8-07d7f1231290 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:36.786250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29472-cc88-4985-94b8-07d7f1231290 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:36.786550 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29472-cc88-4985-94b8-07d7f1231290 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:36.787253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d29472-cc88-4985-94b8-07d7f1231290 None admin] RBAC: Adding query filter params (name=member) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:36.787558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d29472-cc88-4985-94b8-07d7f1231290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:36.788983 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d29472-cc88-4985-94b8-07d7f1231290 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:36.802835 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 190/384] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:36.808719 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae7bf-39aa-4679-b387-0ad8db30f379 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:36.974324 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae7bf-39aa-4679-b387-0ad8db30f379 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:37.023633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd777145-dd27-4fb3-b8cc-153fe2892cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:37.025132 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777145-dd27-4fb3-b8cc-153fe2892cdc None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:37.025632 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777145-dd27-4fb3-b8cc-153fe2892cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:37.026147 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777145-dd27-4fb3-b8cc-153fe2892cdc None admin] PATH_INFO: `/v3/groups/d386962cc5c342bb80fc641fdbb71f37` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:37.027477 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd777145-dd27-4fb3-b8cc-153fe2892cdc None admin] RBAC: Authorizing `identity:get_group(group_id=d386962cc5c342bb80fc641fdbb71f37)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:37.029115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd777145-dd27-4fb3-b8cc-153fe2892cdc None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:37.034628 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 195/385] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:36 2022] GET /identity/v3/groups/d386962cc5c342bb80fc641fdbb71f37 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:37.036962 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29472-cc88-4985-94b8-07d7f1231290 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:37.073836 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba564d-cec0-40c8-846c-aff1dd57c6c7 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:37.074136 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba564d-cec0-40c8-846c-aff1dd57c6c7 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:37.074429 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba564d-cec0-40c8-846c-aff1dd57c6c7 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:37.075768 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 196/386] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:53:37.110640 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a305c-e584-4a16-b4ae-29bdba014d14 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:37.110961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a305c-e584-4a16-b4ae-29bdba014d14 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:37.111212 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a305c-e584-4a16-b4ae-29bdba014d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:37.139236 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-900a305c-e584-4a16-b4ae-29bdba014d14 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:37.140440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-900a305c-e584-4a16-b4ae-29bdba014d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:37.197576 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:37.206632 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:37.207940 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29472-cc88-4985-94b8-07d7f1231290 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:37.271478 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 197/387] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:37.279051 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f90c2-0982-423b-b37b-3485dc984487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:37.279701 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f90c2-0982-423b-b37b-3485dc984487 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:37.279989 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f90c2-0982-423b-b37b-3485dc984487 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:37.280266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f90c2-0982-423b-b37b-3485dc984487 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:37.281422 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f90c2-0982-423b-b37b-3485dc984487 None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:37.282913 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f90c2-0982-423b-b37b-3485dc984487 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:37.284891 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 191/388] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:37 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:37.290777 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a305c-e584-4a16-b4ae-29bdba014d14 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:37.423368 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a305c-e584-4a16-b4ae-29bdba014d14 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:37.473746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773c8b0-8459-49ba-aa8c-732c840eee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:37.474495 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773c8b0-8459-49ba-aa8c-732c840eee74 None admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:37.474778 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773c8b0-8459-49ba-aa8c-732c840eee74 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:37.475055 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773c8b0-8459-49ba-aa8c-732c840eee74 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871/groups/d386962cc5c342bb80fc641fdbb71f37/roles/807b71faee4a435e95e2ca3296e64c2e` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:37.477361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773c8b0-8459-49ba-aa8c-732c840eee74 None admin] RBAC: Authorizing `identity:create_grant(project_id=45e07b89720a4d87bfe2ca7a011f0871, group_id=d386962cc5c342bb80fc641fdbb71f37, role_id=807b71faee4a435e95e2ca3296e64c2e)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:37.479145 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773c8b0-8459-49ba-aa8c-732c840eee74 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:37.554835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 198/389] 10.222.0.52 () {58 vars in 1442 bytes} [Wed Aug 31 14:53:37 2022] PUT /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871/groups/d386962cc5c342bb80fc641fdbb71f37/roles/807b71faee4a435e95e2ca3296e64c2e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:53:37.701847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f90c2-0982-423b-b37b-3485dc984487 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:37.729192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dcbde-65a7-499d-9998-754a0aeb2635 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:37.729534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dcbde-65a7-499d-9998-754a0aeb2635 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:37.729755 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dcbde-65a7-499d-9998-754a0aeb2635 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:37.731605 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 199/390] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:37.737565 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137faa0-bfff-4f0d-9f18-0ad601066999 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:37.737854 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137faa0-bfff-4f0d-9f18-0ad601066999 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:37.738158 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137faa0-bfff-4f0d-9f18-0ad601066999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:37.758784 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-4137faa0-bfff-4f0d-9f18-0ad601066999 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:37.760002 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-4137faa0-bfff-4f0d-9f18-0ad601066999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:37.794721 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:37.850495 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 200/391] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:37.889061 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f90c2-0982-423b-b37b-3485dc984487 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:37.927783 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4e0e0-b198-40ac-87c9-f310f0a527d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:37.928761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4e0e0-b198-40ac-87c9-f310f0a527d8 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:37.929240 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4e0e0-b198-40ac-87c9-f310f0a527d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:37.929826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4e0e0-b198-40ac-87c9-f310f0a527d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:37.941550 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4e0e0-b198-40ac-87c9-f310f0a527d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-4bf4e0e0-b198-40ac-87c9-f310f0a527d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:37.947354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:37.948225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:37.949006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:37.949006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:37.949006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:37.949006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:37.949006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:37.949006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:37.949006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:37.949006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:37.949006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:37.949006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:37.949006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:37.949006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:37.951656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 192/392] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:53:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:37.957223 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137faa0-bfff-4f0d-9f18-0ad601066999 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:37.997260 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e22476-ea42-4d74-aae8-061da46570b7 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:37.997834 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e22476-ea42-4d74-aae8-061da46570b7 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:37.998112 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e22476-ea42-4d74-aae8-061da46570b7 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:37.999477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 193/393] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:53:38.004653 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f2777-4332-4f26-a9cb-c22f95d84479 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:38.004944 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f2777-4332-4f26-a9cb-c22f95d84479 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:38.005219 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f2777-4332-4f26-a9cb-c22f95d84479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:38.035388 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-890f2777-4332-4f26-a9cb-c22f95d84479 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:38.036599 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-890f2777-4332-4f26-a9cb-c22f95d84479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:38.062641 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:38.095573 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137faa0-bfff-4f0d-9f18-0ad601066999 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:38.131686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1e92e-67aa-4e02-b3e8-1f24354f7a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:38.132219 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1e92e-67aa-4e02-b3e8-1f24354f7a64 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:38.132500 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1e92e-67aa-4e02-b3e8-1f24354f7a64 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:38.132772 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1e92e-67aa-4e02-b3e8-1f24354f7a64 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:38.134145 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1e92e-67aa-4e02-b3e8-1f24354f7a64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:38.134499 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1e92e-67aa-4e02-b3e8-1f24354f7a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:38.135893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1e92e-67aa-4e02-b3e8-1f24354f7a64 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:38.136354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 194/394] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:38.145002 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 201/395] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:38.151268 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f2777-4332-4f26-a9cb-c22f95d84479 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:38.277946 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1e92e-67aa-4e02-b3e8-1f24354f7a64 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:38.301897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:38.313520 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f2777-4332-4f26-a9cb-c22f95d84479 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:38.395116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f95f0-3ad8-4d9b-b787-c00ff9df480e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:38.395685 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f95f0-3ad8-4d9b-b787-c00ff9df480e None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:38.395965 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f95f0-3ad8-4d9b-b787-c00ff9df480e None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:38.396241 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f95f0-3ad8-4d9b-b787-c00ff9df480e None admin] PATH_INFO: `/v3/groups/d386962cc5c342bb80fc641fdbb71f37` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:38.398162 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f95f0-3ad8-4d9b-b787-c00ff9df480e None admin] RBAC: Authorizing `identity:get_group(group_id=d386962cc5c342bb80fc641fdbb71f37)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:38.399659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f95f0-3ad8-4d9b-b787-c00ff9df480e None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:38.404397 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1e92e-67aa-4e02-b3e8-1f24354f7a64 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:38.405939 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 195/396] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:38 2022] GET /identity/v3/groups/d386962cc5c342bb80fc641fdbb71f37 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:38.407910 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f95f0-3ad8-4d9b-b787-c00ff9df480e None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:38.445689 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:38.533387 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f95f0-3ad8-4d9b-b787-c00ff9df480e None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:38.536379 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23edab-8694-4b94-a2e0-ede8037a76f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:38.537610 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23edab-8694-4b94-a2e0-ede8037a76f0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:38.538094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23edab-8694-4b94-a2e0-ede8037a76f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:38.538599 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23edab-8694-4b94-a2e0-ede8037a76f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:38.555844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23edab-8694-4b94-a2e0-ede8037a76f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-1d23edab-8694-4b94-a2e0-ede8037a76f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:38.561166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:38.562051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:38.562974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:38.562974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:38.562974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:38.562974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:38.562974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:38.562974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:38.562974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:38.562974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:38.562974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:38.562974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:38.562974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:38.562974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:38.566476 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 202/397] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:38.567320 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23edab-8694-4b94-a2e0-ede8037a76f0 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:38.583556 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22c311-a516-4b25-b75a-c72cc9c77b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:38.584584 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22c311-a516-4b25-b75a-c72cc9c77b81 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:38.585225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22c311-a516-4b25-b75a-c72cc9c77b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:38.585704 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22c311-a516-4b25-b75a-c72cc9c77b81 None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:38.588661 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22c311-a516-4b25-b75a-c72cc9c77b81 None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:38.590360 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22c311-a516-4b25-b75a-c72cc9c77b81 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:38.597018 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 196/398] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:38 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:38.597018 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22c311-a516-4b25-b75a-c72cc9c77b81 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:38.681768 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:38.699012 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:38.710877 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22c311-a516-4b25-b75a-c72cc9c77b81 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:38.716195 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23edab-8694-4b94-a2e0-ede8037a76f0 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:38.755334 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea9351-ebfc-4f2e-b9f6-608b2aa58c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:38.756186 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea9351-ebfc-4f2e-b9f6-608b2aa58c19 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:38.756525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea9351-ebfc-4f2e-b9f6-608b2aa58c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:38.756924 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea9351-ebfc-4f2e-b9f6-608b2aa58c19 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:38.757730 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea9351-ebfc-4f2e-b9f6-608b2aa58c19 None admin] RBAC: Adding query filter params (name=member) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:38.758159 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea9351-ebfc-4f2e-b9f6-608b2aa58c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:38.760241 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea9351-ebfc-4f2e-b9f6-608b2aa58c19 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:38.760892 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29d95b-f75c-4502-9c1a-d98db0d1b304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:38.761671 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29d95b-f75c-4502-9c1a-d98db0d1b304 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:38.762357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29d95b-f75c-4502-9c1a-d98db0d1b304 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:38.762788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29d95b-f75c-4502-9c1a-d98db0d1b304 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:38.775456 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 197/399] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:38.775456 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea9351-ebfc-4f2e-b9f6-608b2aa58c19 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:38.782645 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29d95b-f75c-4502-9c1a-d98db0d1b304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-2d29d95b-f75c-4502-9c1a-d98db0d1b304 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:38.790121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:38.791249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:38.792208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:38.792208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:38.792208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:38.792208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:38.792208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:38.792208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:38.792208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:38.792208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:38.792208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:38.792208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:38.792208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:38.792208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:38.795243 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 203/400] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:53:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:38.796536 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29d95b-f75c-4502-9c1a-d98db0d1b304 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:38.914926 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea9351-ebfc-4f2e-b9f6-608b2aa58c19 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:38.923548 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29d95b-f75c-4502-9c1a-d98db0d1b304 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:38.959366 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2dcb7-1521-4b48-899b-bcd7a2bc655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:38.959955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2dcb7-1521-4b48-899b-bcd7a2bc655d None admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:38.960236 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2dcb7-1521-4b48-899b-bcd7a2bc655d None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:38.960510 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2dcb7-1521-4b48-899b-bcd7a2bc655d None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871/groups/d386962cc5c342bb80fc641fdbb71f37/roles/a3a5839e9bda47d8af7a7b707f7a9888` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:38.963054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b31a1-e95f-4d34-80e5-68325b9db413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:38.963379 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2dcb7-1521-4b48-899b-bcd7a2bc655d None admin] RBAC: Authorizing `identity:create_grant(project_id=45e07b89720a4d87bfe2ca7a011f0871, group_id=d386962cc5c342bb80fc641fdbb71f37, role_id=a3a5839e9bda47d8af7a7b707f7a9888)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:38.963686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b31a1-e95f-4d34-80e5-68325b9db413 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:38.963968 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b31a1-e95f-4d34-80e5-68325b9db413 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:38.964241 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b31a1-e95f-4d34-80e5-68325b9db413 None admin] PATH_INFO: `/v3/groups/d386962cc5c342bb80fc641fdbb71f37` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:38.964870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2dcb7-1521-4b48-899b-bcd7a2bc655d None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:38.965366 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b31a1-e95f-4d34-80e5-68325b9db413 None admin] RBAC: Authorizing `identity:get_group(group_id=d386962cc5c342bb80fc641fdbb71f37)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:38.966966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b31a1-e95f-4d34-80e5-68325b9db413 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:38.968641 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 204/401] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:38 2022] GET /identity/v3/groups/d386962cc5c342bb80fc641fdbb71f37 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:38.969360 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b31a1-e95f-4d34-80e5-68325b9db413 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:38.979350 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:39.017588 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 198/402] 10.222.0.52 () {58 vars in 1442 bytes} [Wed Aug 31 14:53:38 2022] PUT /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871/groups/d386962cc5c342bb80fc641fdbb71f37/roles/a3a5839e9bda47d8af7a7b707f7a9888 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:53:39.024580 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bda0e-a0c7-4b46-86e2-84697b887421 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:39.024580 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bda0e-a0c7-4b46-86e2-84697b887421 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:39.024580 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bda0e-a0c7-4b46-86e2-84697b887421 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:39.024580 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 199/403] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:39.024580 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bda0e-a0c7-4b46-86e2-84697b887421 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:39.037134 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:39.119588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b31a1-e95f-4d34-80e5-68325b9db413 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:39.151896 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bda0e-a0c7-4b46-86e2-84697b887421 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:39.167929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b70df-896a-4c33-badb-c2835a684ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:39.168557 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b70df-896a-4c33-badb-c2835a684ee1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:39.168842 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b70df-896a-4c33-badb-c2835a684ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:39.169120 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b70df-896a-4c33-badb-c2835a684ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:39.169798 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b70df-896a-4c33-badb-c2835a684ee1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:39.170105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b70df-896a-4c33-badb-c2835a684ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:39.171638 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b70df-896a-4c33-badb-c2835a684ee1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:39.181497 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 205/404] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:39.183027 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517360bc-3f4e-4423-836b-6c7481c75720 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:39.183316 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517360bc-3f4e-4423-836b-6c7481c75720 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:39.183594 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517360bc-3f4e-4423-836b-6c7481c75720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:39.197464 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75516f7-d055-4b65-8807-1cb0dc14387c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:39.198114 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75516f7-d055-4b65-8807-1cb0dc14387c None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:39.198477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75516f7-d055-4b65-8807-1cb0dc14387c None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:39.198757 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75516f7-d055-4b65-8807-1cb0dc14387c None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:39.200127 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75516f7-d055-4b65-8807-1cb0dc14387c None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:39.201669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75516f7-d055-4b65-8807-1cb0dc14387c None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:39.204300 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 200/405] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:39 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:39.204300 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75516f7-d055-4b65-8807-1cb0dc14387c None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:39.204873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-517360bc-3f4e-4423-836b-6c7481c75720 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:39.206208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-517360bc-3f4e-4423-836b-6c7481c75720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:39.279920 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:39.286256 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 206/406] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:39.287367 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517360bc-3f4e-4423-836b-6c7481c75720 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:39.298977 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:39.323864 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75516f7-d055-4b65-8807-1cb0dc14387c None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:39.387354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f0df4-ecbb-44ca-a61c-0b8c877c9d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:39.387994 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f0df4-ecbb-44ca-a61c-0b8c877c9d3b None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:39.388277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f0df4-ecbb-44ca-a61c-0b8c877c9d3b None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:39.388554 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f0df4-ecbb-44ca-a61c-0b8c877c9d3b None admin] PATH_INFO: `/v3/groups/d386962cc5c342bb80fc641fdbb71f37` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:39.389824 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f0df4-ecbb-44ca-a61c-0b8c877c9d3b None admin] RBAC: Authorizing `identity:get_group(group_id=d386962cc5c342bb80fc641fdbb71f37)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:39.391307 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f0df4-ecbb-44ca-a61c-0b8c877c9d3b None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:39.393329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 201/407] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:39 2022] GET /identity/v3/groups/d386962cc5c342bb80fc641fdbb71f37 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:39.401995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f0df4-ecbb-44ca-a61c-0b8c877c9d3b None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:39.463631 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517360bc-3f4e-4423-836b-6c7481c75720 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:39.505493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b1afa-ae69-422f-a691-cf4d9c914647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:39.506633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b1afa-ae69-422f-a691-cf4d9c914647 None admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:39.507120 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b1afa-ae69-422f-a691-cf4d9c914647 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:39.507586 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b1afa-ae69-422f-a691-cf4d9c914647 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86/groups/d386962cc5c342bb80fc641fdbb71f37/roles/807b71faee4a435e95e2ca3296e64c2e` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:39.510253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b1afa-ae69-422f-a691-cf4d9c914647 None admin] RBAC: Authorizing `identity:create_grant(project_id=a37fe08aba474a1bb58912f977979b86, group_id=d386962cc5c342bb80fc641fdbb71f37, role_id=807b71faee4a435e95e2ca3296e64c2e)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:39.511968 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b1afa-ae69-422f-a691-cf4d9c914647 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:39.568117 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f0df4-ecbb-44ca-a61c-0b8c877c9d3b None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:39.605170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768c9c-1acd-4491-8ecf-16db800ead88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:39.605814 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768c9c-1acd-4491-8ecf-16db800ead88 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:39.606096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768c9c-1acd-4491-8ecf-16db800ead88 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:39.606403 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768c9c-1acd-4491-8ecf-16db800ead88 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:39.607548 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79768c9c-1acd-4491-8ecf-16db800ead88 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:39.609288 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79768c9c-1acd-4491-8ecf-16db800ead88 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:39.611341 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 202/408] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:39 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:39.621224 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 207/409] 10.222.0.52 () {58 vars in 1442 bytes} [Wed Aug 31 14:53:39 2022] PUT /identity/v3/projects/a37fe08aba474a1bb58912f977979b86/groups/d386962cc5c342bb80fc641fdbb71f37/roles/807b71faee4a435e95e2ca3296e64c2e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:53:39.624259 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768c9c-1acd-4491-8ecf-16db800ead88 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:39.643598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:39.748058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b1afa-ae69-422f-a691-cf4d9c914647 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:39.763771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768c9c-1acd-4491-8ecf-16db800ead88 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:39.834028 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:39.867431 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dec8d-9206-4d71-8808-1c491a4d8f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:39.873487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dec8d-9206-4d71-8808-1c491a4d8f0a None admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:39.873487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dec8d-9206-4d71-8808-1c491a4d8f0a None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:39.873487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dec8d-9206-4d71-8808-1c491a4d8f0a None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86/groups/d386962cc5c342bb80fc641fdbb71f37/roles/a3a5839e9bda47d8af7a7b707f7a9888` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:39.873487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dec8d-9206-4d71-8808-1c491a4d8f0a None admin] RBAC: Authorizing `identity:create_grant(project_id=a37fe08aba474a1bb58912f977979b86, group_id=d386962cc5c342bb80fc641fdbb71f37, role_id=a3a5839e9bda47d8af7a7b707f7a9888)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:39.875390 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dec8d-9206-4d71-8808-1c491a4d8f0a None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:39.898520 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b1afa-ae69-422f-a691-cf4d9c914647 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:39.941087 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14824b63-0d62-46f4-b309-8fe120194ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:39.941718 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824b63-0d62-46f4-b309-8fe120194ffb None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:39.941998 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824b63-0d62-46f4-b309-8fe120194ffb None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:39.942271 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824b63-0d62-46f4-b309-8fe120194ffb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:39.953873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14824b63-0d62-46f4-b309-8fe120194ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-14824b63-0d62-46f4-b309-8fe120194ffb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:39.962504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:39.972359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:39.973139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:39.973139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:39.973139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:39.973139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:39.973139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:39.973139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:39.973139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:39.973139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:39.973139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:39.973139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:39.973139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:39.973139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:39.973731 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 203/410] 10.222.0.52 () {58 vars in 1442 bytes} [Wed Aug 31 14:53:39 2022] PUT /identity/v3/projects/a37fe08aba474a1bb58912f977979b86/groups/d386962cc5c342bb80fc641fdbb71f37/roles/a3a5839e9bda47d8af7a7b707f7a9888 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 14:53:39.973802 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 208/411] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:53:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:39.975063 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dec8d-9206-4d71-8808-1c491a4d8f0a None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:40.077554 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:40.121092 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dec8d-9206-4d71-8808-1c491a4d8f0a None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:40.131144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5698e-ba8e-4072-984f-dd6f54dea885 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:40.131448 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5698e-ba8e-4072-984f-dd6f54dea885 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:40.131701 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5698e-ba8e-4072-984f-dd6f54dea885 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:40.133873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 209/412] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:40.138913 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6eba0-a980-4c45-8074-4c9832d474f1 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:40.139197 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6eba0-a980-4c45-8074-4c9832d474f1 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:40.139470 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6eba0-a980-4c45-8074-4c9832d474f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:40.167387 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-ced6eba0-a980-4c45-8074-4c9832d474f1 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:40.168628 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-ced6eba0-a980-4c45-8074-4c9832d474f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:40.207526 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddebe27-ee17-4e66-9b24-a5c38e10fd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:40.209167 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddebe27-ee17-4e66-9b24-a5c38e10fd61 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:40.209167 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddebe27-ee17-4e66-9b24-a5c38e10fd61 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:40.209167 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddebe27-ee17-4e66-9b24-a5c38e10fd61 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:40.209409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddebe27-ee17-4e66-9b24-a5c38e10fd61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:40.209621 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddebe27-ee17-4e66-9b24-a5c38e10fd61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:40.212448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddebe27-ee17-4e66-9b24-a5c38e10fd61 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:40.225431 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 204/413] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:40.233193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddebe27-ee17-4e66-9b24-a5c38e10fd61 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:40.275080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 210/414] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:40.346111 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddebe27-ee17-4e66-9b24-a5c38e10fd61 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:40.388800 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45100057-2408-4c84-b587-dfec8006499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:40.389756 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45100057-2408-4c84-b587-dfec8006499e None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:40.390360 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45100057-2408-4c84-b587-dfec8006499e None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:40.390841 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45100057-2408-4c84-b587-dfec8006499e None admin] PATH_INFO: `/v3/groups/fb2d751aa55d4caea12b2f6eb256eafc` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:40.392174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45100057-2408-4c84-b587-dfec8006499e None admin] RBAC: Authorizing `identity:get_group(group_id=fb2d751aa55d4caea12b2f6eb256eafc)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:40.393899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45100057-2408-4c84-b587-dfec8006499e None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:40.395982 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 205/415] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:40 2022] GET /identity/v3/groups/fb2d751aa55d4caea12b2f6eb256eafc => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:40.401865 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6eba0-a980-4c45-8074-4c9832d474f1 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:40.488265 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:40.556777 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6eba0-a980-4c45-8074-4c9832d474f1 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:40.609264 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74924a60-3f34-4dcf-80db-7c5792e097e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:40.609907 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924a60-3f34-4dcf-80db-7c5792e097e0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:40.610197 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924a60-3f34-4dcf-80db-7c5792e097e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:40.610501 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924a60-3f34-4dcf-80db-7c5792e097e0 None admin] PATH_INFO: `/v3/projects/b905fa215ef84f989a1edb29db9488aa` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:40.611654 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74924a60-3f34-4dcf-80db-7c5792e097e0 None admin] RBAC: Authorizing `identity:get_project(project_id=b905fa215ef84f989a1edb29db9488aa)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:40.613104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74924a60-3f34-4dcf-80db-7c5792e097e0 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:40.615125 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 211/416] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:40 2022] GET /identity/v3/projects/b905fa215ef84f989a1edb29db9488aa => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:40.621559 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45100057-2408-4c84-b587-dfec8006499e None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:40.627303 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:40.681915 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74924a60-3f34-4dcf-80db-7c5792e097e0 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:40.759351 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45100057-2408-4c84-b587-dfec8006499e None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:40.803136 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7795ed2-2043-433d-a2d0-c5a2ca7ea585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:40.803832 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7795ed2-2043-433d-a2d0-c5a2ca7ea585 None admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:40.805752 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7795ed2-2043-433d-a2d0-c5a2ca7ea585 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:40.805752 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7795ed2-2043-433d-a2d0-c5a2ca7ea585 None admin] PATH_INFO: `/v3/projects/b905fa215ef84f989a1edb29db9488aa/groups/fb2d751aa55d4caea12b2f6eb256eafc/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:40.810454 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7795ed2-2043-433d-a2d0-c5a2ca7ea585 None admin] RBAC: Authorizing `identity:create_grant(project_id=b905fa215ef84f989a1edb29db9488aa, group_id=fb2d751aa55d4caea12b2f6eb256eafc, role_id=7fe1d0d9f098408c9dc7ed9fca08a4a4)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:40.812557 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7795ed2-2043-433d-a2d0-c5a2ca7ea585 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:40.858514 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74924a60-3f34-4dcf-80db-7c5792e097e0 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:40.876014 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:40.885447 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 206/417] 10.222.0.52 () {58 vars in 1442 bytes} [Wed Aug 31 14:53:40 2022] PUT /identity/v3/projects/b905fa215ef84f989a1edb29db9488aa/groups/fb2d751aa55d4caea12b2f6eb256eafc/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:53:40.896971 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545b98-5013-45e8-806b-a78d7a47e027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:40.897945 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545b98-5013-45e8-806b-a78d7a47e027 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:40.898476 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545b98-5013-45e8-806b-a78d7a47e027 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:40.899447 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545b98-5013-45e8-806b-a78d7a47e027 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:40.913428 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5545b98-5013-45e8-806b-a78d7a47e027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-c5545b98-5013-45e8-806b-a78d7a47e027 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:40.919079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:40.920247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:40.921216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:40.921216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:40.921216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:40.921216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:40.921216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:40.921216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:40.921216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:40.921216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:40.921216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:40.921216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:40.921216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:40.921216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:40.923453 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 212/418] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:40.929747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7795ed2-2043-433d-a2d0-c5a2ca7ea585 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:41.052416 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:41.105279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7795ed2-2043-433d-a2d0-c5a2ca7ea585 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:41.151780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d97c78-5abd-46f0-b002-df25c5979ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:41.152404 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97c78-5abd-46f0-b002-df25c5979ba6 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:41.152686 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97c78-5abd-46f0-b002-df25c5979ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:41.152962 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97c78-5abd-46f0-b002-df25c5979ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:41.153679 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d97c78-5abd-46f0-b002-df25c5979ba6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:41.153991 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d97c78-5abd-46f0-b002-df25c5979ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:41.155397 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d97c78-5abd-46f0-b002-df25c5979ba6 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:41.166573 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 207/419] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:41.172455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545b98-5013-45e8-806b-a78d7a47e027 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:41.321652 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545b98-5013-45e8-806b-a78d7a47e027 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:41.361705 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0533d8-c64d-4752-8a89-b8be681de618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:41.362336 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0533d8-c64d-4752-8a89-b8be681de618 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:41.362627 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0533d8-c64d-4752-8a89-b8be681de618 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:41.362904 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0533d8-c64d-4752-8a89-b8be681de618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:41.422556 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:41.450543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0533d8-c64d-4752-8a89-b8be681de618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:41.452295 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0533d8-c64d-4752-8a89-b8be681de618 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:41.583411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 213/420] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:41.589270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d97c78-5abd-46f0-b002-df25c5979ba6 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:41.745780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d97c78-5abd-46f0-b002-df25c5979ba6 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:41.779894 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:41.791554 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f9a45-c304-4e4a-9252-a3ebb2b952ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:41.801874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f9a45-c304-4e4a-9252-a3ebb2b952ed None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:41.801874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f9a45-c304-4e4a-9252-a3ebb2b952ed None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:41.801874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f9a45-c304-4e4a-9252-a3ebb2b952ed None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:41.801874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f9a45-c304-4e4a-9252-a3ebb2b952ed None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:41.801874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f9a45-c304-4e4a-9252-a3ebb2b952ed None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:41.802506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 208/421] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:41 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:41.808149 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0533d8-c64d-4752-8a89-b8be681de618 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:41.882656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b97ee-5f86-47a3-b507-54df9e18466a None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:41.884236 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b97ee-5f86-47a3-b507-54df9e18466a None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:41.884737 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b97ee-5f86-47a3-b507-54df9e18466a None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:41.887653 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 209/422] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:41.892063 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402d8ce-3947-4085-ad7c-33f4ce3f82ce None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:41.892567 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402d8ce-3947-4085-ad7c-33f4ce3f82ce None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:41.893062 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402d8ce-3947-4085-ad7c-33f4ce3f82ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:41.923174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-0402d8ce-3947-4085-ad7c-33f4ce3f82ce None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:41.925445 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:41.928920 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-0402d8ce-3947-4085-ad7c-33f4ce3f82ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:41.973655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0533d8-c64d-4752-8a89-b8be681de618 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:42.041887 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1149827-cee2-4491-b8e7-bbd70a8d16a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:42.042898 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1149827-cee2-4491-b8e7-bbd70a8d16a9 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:42.043416 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1149827-cee2-4491-b8e7-bbd70a8d16a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:42.043971 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1149827-cee2-4491-b8e7-bbd70a8d16a9 None admin] PATH_INFO: `/v3/groups/d386962cc5c342bb80fc641fdbb71f37` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:42.047152 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1149827-cee2-4491-b8e7-bbd70a8d16a9 None admin] RBAC: Authorizing `identity:get_group(group_id=d386962cc5c342bb80fc641fdbb71f37)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:42.049670 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1149827-cee2-4491-b8e7-bbd70a8d16a9 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:42.053919 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 214/423] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:41 2022] GET /identity/v3/groups/d386962cc5c342bb80fc641fdbb71f37 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:42.058640 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1149827-cee2-4491-b8e7-bbd70a8d16a9 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:42.071284 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 210/424] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:42.208554 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1149827-cee2-4491-b8e7-bbd70a8d16a9 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:42.255933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37e033-0a2c-4564-8b81-7d51524cf630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:42.256553 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37e033-0a2c-4564-8b81-7d51524cf630 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:42.256830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37e033-0a2c-4564-8b81-7d51524cf630 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:42.257101 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37e033-0a2c-4564-8b81-7d51524cf630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:42.257837 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37e033-0a2c-4564-8b81-7d51524cf630 None admin] RBAC: Adding query filter params (group.id=d386962cc5c342bb80fc641fdbb71f37, role.id=807b71faee4a435e95e2ca3296e64c2e, scope.project.id=45e07b89720a4d87bfe2ca7a011f0871) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:42.258820 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37e033-0a2c-4564-8b81-7d51524cf630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:42.260262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37e033-0a2c-4564-8b81-7d51524cf630 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:42.270773 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 215/425] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 31 14:53:42 2022] GET /identity/v3/role_assignments?group.id=d386962cc5c342bb80fc641fdbb71f37&scope.project.id=45e07b89720a4d87bfe2ca7a011f0871&role.id=807b71faee4a435e95e2ca3296e64c2e => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:42.288184 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e5d5-b717-4686-a396-7f1cd2426d2a None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:42.288817 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e5d5-b717-4686-a396-7f1cd2426d2a None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:42.289374 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e5d5-b717-4686-a396-7f1cd2426d2a None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:42.291146 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 211/426] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:42.304185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888a8fd-d850-4485-9cd0-cd40bcba5aea None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:42.304482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888a8fd-d850-4485-9cd0-cd40bcba5aea None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:42.304860 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888a8fd-d850-4485-9cd0-cd40bcba5aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:42.335390 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-0888a8fd-d850-4485-9cd0-cd40bcba5aea None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:42.336717 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-0888a8fd-d850-4485-9cd0-cd40bcba5aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:42.339015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:42.436908 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 216/427] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:42.494282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29e5d5-b717-4686-a396-7f1cd2426d2a None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:42.604962 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29e5d5-b717-4686-a396-7f1cd2426d2a None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:42.633106 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:42.646840 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26802a4b-ef17-4794-8978-9a85dce92dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:42.647896 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26802a4b-ef17-4794-8978-9a85dce92dc8 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:42.648437 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26802a4b-ef17-4794-8978-9a85dce92dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:42.649496 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26802a4b-ef17-4794-8978-9a85dce92dc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:42.665941 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26802a4b-ef17-4794-8978-9a85dce92dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-26802a4b-ef17-4794-8978-9a85dce92dc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:42.671635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:42.678158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:42.679005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 212/428] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:53:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:42.682979 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888a8fd-d850-4485-9cd0-cd40bcba5aea None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:42.806961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888a8fd-d850-4485-9cd0-cd40bcba5aea None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:42.810361 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26802a4b-ef17-4794-8978-9a85dce92dc8 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:42.859757 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35a8ad-a356-4847-8eae-6b1490e99c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:42.860620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35a8ad-a356-4847-8eae-6b1490e99c4b None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:42.860897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35a8ad-a356-4847-8eae-6b1490e99c4b None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:42.861583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35a8ad-a356-4847-8eae-6b1490e99c4b None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:42.862442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35a8ad-a356-4847-8eae-6b1490e99c4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:42.862865 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35a8ad-a356-4847-8eae-6b1490e99c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:42.864892 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35a8ad-a356-4847-8eae-6b1490e99c4b None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:42.874631 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:42.879234 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 217/429] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:42.881266 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea4eb-655f-4b48-b8b2-c8605a45c34e None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:42.886812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea4eb-655f-4b48-b8b2-c8605a45c34e None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:42.886812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea4eb-655f-4b48-b8b2-c8605a45c34e None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:42.886812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 218/430] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:42.886812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fea4eb-655f-4b48-b8b2-c8605a45c34e None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:42.960068 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26802a4b-ef17-4794-8978-9a85dce92dc8 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:43.015610 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e3799-8642-488d-a031-47c3554a1d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:43.016346 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e3799-8642-488d-a031-47c3554a1d89 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:43.016817 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e3799-8642-488d-a031-47c3554a1d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:43.017026 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e3799-8642-488d-a031-47c3554a1d89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:43.022637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fea4eb-655f-4b48-b8b2-c8605a45c34e None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:43.029277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e3799-8642-488d-a031-47c3554a1d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-ac0e3799-8642-488d-a031-47c3554a1d89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:43.035317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:43.036235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:43.037087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 213/431] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:43.038738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3e7bb-4148-47f9-8384-33748ff9d3b8 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:43.038996 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3e7bb-4148-47f9-8384-33748ff9d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:43.039838 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3e7bb-4148-47f9-8384-33748ff9d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:43.067856 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-04a3e7bb-4148-47f9-8384-33748ff9d3b8 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:43.069194 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-04a3e7bb-4148-47f9-8384-33748ff9d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:43.075542 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c73740-10ca-49c6-b5d2-838cf4395437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:43.076155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c73740-10ca-49c6-b5d2-838cf4395437 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:43.076430 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c73740-10ca-49c6-b5d2-838cf4395437 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:43.076702 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c73740-10ca-49c6-b5d2-838cf4395437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:43.123469 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:43.151001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 214/432] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:43.152093 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3e7bb-4148-47f9-8384-33748ff9d3b8 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:43.159711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:43.162583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c73740-10ca-49c6-b5d2-838cf4395437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:43.164321 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c73740-10ca-49c6-b5d2-838cf4395437 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:43.278860 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 219/433] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:43.280543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c73740-10ca-49c6-b5d2-838cf4395437 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:43.284243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3e7bb-4148-47f9-8384-33748ff9d3b8 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:43.331984 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4ee97-c0dd-4ec4-ac58-9ee5a75f8217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:43.332576 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4ee97-c0dd-4ec4-ac58-9ee5a75f8217 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:43.332859 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4ee97-c0dd-4ec4-ac58-9ee5a75f8217 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:43.333130 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4ee97-c0dd-4ec4-ac58-9ee5a75f8217 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:43.333788 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4ee97-c0dd-4ec4-ac58-9ee5a75f8217 None admin] RBAC: Adding query filter params (name=member) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:43.334088 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4ee97-c0dd-4ec4-ac58-9ee5a75f8217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:43.336042 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4ee97-c0dd-4ec4-ac58-9ee5a75f8217 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:43.350340 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 215/434] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:53:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:43.355899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4ee97-c0dd-4ec4-ac58-9ee5a75f8217 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:43.403965 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:43.407112 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:43.410333 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c73740-10ca-49c6-b5d2-838cf4395437 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:43.448715 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943c884-a973-43c8-8612-da6a3e7dea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:43.449760 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943c884-a973-43c8-8612-da6a3e7dea0e None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:43.450311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943c884-a973-43c8-8612-da6a3e7dea0e None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:43.450787 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943c884-a973-43c8-8612-da6a3e7dea0e None admin] PATH_INFO: `/v3/projects/45e07b89720a4d87bfe2ca7a011f0871` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:43.452262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943c884-a973-43c8-8612-da6a3e7dea0e None admin] RBAC: Authorizing `identity:get_project(project_id=45e07b89720a4d87bfe2ca7a011f0871)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:43.454000 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943c884-a973-43c8-8612-da6a3e7dea0e None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:43.456351 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 220/435] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:43 2022] GET /identity/v3/projects/45e07b89720a4d87bfe2ca7a011f0871 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:43.461853 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943c884-a973-43c8-8612-da6a3e7dea0e None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:43.493527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4ee97-c0dd-4ec4-ac58-9ee5a75f8217 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:43.531905 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb4040-9dbe-442b-bd35-85edfb47837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:43.533230 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb4040-9dbe-442b-bd35-85edfb47837e None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:43.533788 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb4040-9dbe-442b-bd35-85edfb47837e None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:43.534336 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb4040-9dbe-442b-bd35-85edfb47837e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:43.577008 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943c884-a973-43c8-8612-da6a3e7dea0e None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:43.613727 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb4040-9dbe-442b-bd35-85edfb47837e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:43.614884 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313d3c8-b960-43f2-b01d-9ca769861278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:43.615138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb4040-9dbe-442b-bd35-85edfb47837e None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:43.615520 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313d3c8-b960-43f2-b01d-9ca769861278 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:43.615801 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313d3c8-b960-43f2-b01d-9ca769861278 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:43.616071 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313d3c8-b960-43f2-b01d-9ca769861278 None admin] PATH_INFO: `/v3/groups/d386962cc5c342bb80fc641fdbb71f37` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:43.617288 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313d3c8-b960-43f2-b01d-9ca769861278 None admin] RBAC: Authorizing `identity:get_group(group_id=d386962cc5c342bb80fc641fdbb71f37)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:43.619603 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313d3c8-b960-43f2-b01d-9ca769861278 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:43.626125 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 221/436] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:43 2022] GET /identity/v3/groups/d386962cc5c342bb80fc641fdbb71f37 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:43.626125 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313d3c8-b960-43f2-b01d-9ca769861278 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:43.655097 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:43.661076 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:43.730618 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313d3c8-b960-43f2-b01d-9ca769861278 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:43.734566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 216/437] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:43.735407 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb4040-9dbe-442b-bd35-85edfb47837e None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:43.765701 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149b6ba-5d53-49fc-8350-c26c6d814b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:43.766356 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149b6ba-5d53-49fc-8350-c26c6d814b14 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:43.766634 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149b6ba-5d53-49fc-8350-c26c6d814b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:43.766903 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149b6ba-5d53-49fc-8350-c26c6d814b14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:43.777046 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149b6ba-5d53-49fc-8350-c26c6d814b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-8149b6ba-5d53-49fc-8350-c26c6d814b14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:43.781882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:43.782855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:43.783651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 222/438] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:53:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:43.784323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063ac23-16d9-487b-a430-de1d6e2fa4fe None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:43.784575 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063ac23-16d9-487b-a430-de1d6e2fa4fe None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:43.784838 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063ac23-16d9-487b-a430-de1d6e2fa4fe None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:43.786000 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 223/439] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:43.786721 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063ac23-16d9-487b-a430-de1d6e2fa4fe None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:43.840214 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb4040-9dbe-442b-bd35-85edfb47837e None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:43.877343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97375a-4d4c-4854-b9ee-51e1711c088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:43.877876 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97375a-4d4c-4854-b9ee-51e1711c088f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:43.878159 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97375a-4d4c-4854-b9ee-51e1711c088f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:43.878474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97375a-4d4c-4854-b9ee-51e1711c088f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:43.879195 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97375a-4d4c-4854-b9ee-51e1711c088f None admin] RBAC: Adding query filter params (group.id=d386962cc5c342bb80fc641fdbb71f37, role.id=a3a5839e9bda47d8af7a7b707f7a9888, scope.project.id=45e07b89720a4d87bfe2ca7a011f0871) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:43.879501 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97375a-4d4c-4854-b9ee-51e1711c088f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:43.880914 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97375a-4d4c-4854-b9ee-51e1711c088f None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:43.883756 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:43.887354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 217/440] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 31 14:53:43 2022] GET /identity/v3/role_assignments?group.id=d386962cc5c342bb80fc641fdbb71f37&scope.project.id=45e07b89720a4d87bfe2ca7a011f0871&role.id=a3a5839e9bda47d8af7a7b707f7a9888 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:43.888055 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97375a-4d4c-4854-b9ee-51e1711c088f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:43.889844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:43.896666 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063ac23-16d9-487b-a430-de1d6e2fa4fe None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:43.938045 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf4a7b-b667-4ec2-8032-d6a76128218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:43.938870 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4a7b-b667-4ec2-8032-d6a76128218d None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:43.939153 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4a7b-b667-4ec2-8032-d6a76128218d None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:43.939544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4a7b-b667-4ec2-8032-d6a76128218d None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:43.940783 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf4a7b-b667-4ec2-8032-d6a76128218d None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:43.942273 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf4a7b-b667-4ec2-8032-d6a76128218d None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:43.944219 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 224/441] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:43 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:43.950608 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaf90c-30c0-4869-8c09-17b70cff5aa2 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:43.950899 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaf90c-30c0-4869-8c09-17b70cff5aa2 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:43.951172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaf90c-30c0-4869-8c09-17b70cff5aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:43.971233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-deaaf90c-30c0-4869-8c09-17b70cff5aa2 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:43.972720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-deaaf90c-30c0-4869-8c09-17b70cff5aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:44.015663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97375a-4d4c-4854-b9ee-51e1711c088f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:44.058329 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 225/442] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:44.058329 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaf90c-30c0-4869-8c09-17b70cff5aa2 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:44.071723 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56915057-6e7c-4559-b485-ef7d88f05283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:44.073117 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56915057-6e7c-4559-b485-ef7d88f05283 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:44.073472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56915057-6e7c-4559-b485-ef7d88f05283 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:44.073820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56915057-6e7c-4559-b485-ef7d88f05283 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:44.074590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56915057-6e7c-4559-b485-ef7d88f05283 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:44.074981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56915057-6e7c-4559-b485-ef7d88f05283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:44.076421 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56915057-6e7c-4559-b485-ef7d88f05283 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:44.091101 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 218/443] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:44.092016 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56915057-6e7c-4559-b485-ef7d88f05283 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:44.162988 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:44.173177 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:44.179086 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaf90c-30c0-4869-8c09-17b70cff5aa2 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:44.218035 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56915057-6e7c-4559-b485-ef7d88f05283 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:44.221037 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3f335-2649-446d-aa47-6c52c52353a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:44.221037 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3f335-2649-446d-aa47-6c52c52353a1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:44.221370 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3f335-2649-446d-aa47-6c52c52353a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:44.222600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3f335-2649-446d-aa47-6c52c52353a1 None admin] PATH_INFO: `/v3/groups/d386962cc5c342bb80fc641fdbb71f37` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:44.223761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3f335-2649-446d-aa47-6c52c52353a1 None admin] RBAC: Authorizing `identity:get_group(group_id=d386962cc5c342bb80fc641fdbb71f37)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:44.225208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3f335-2649-446d-aa47-6c52c52353a1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:44.227389 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 226/444] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:44 2022] GET /identity/v3/groups/d386962cc5c342bb80fc641fdbb71f37 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:44.235615 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3f335-2649-446d-aa47-6c52c52353a1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:44.265378 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f37a8-0288-45c0-8d31-63a3b5e4aaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:44.266068 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f37a8-0288-45c0-8d31-63a3b5e4aaf2 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:44.266402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f37a8-0288-45c0-8d31-63a3b5e4aaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:44.266688 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f37a8-0288-45c0-8d31-63a3b5e4aaf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:44.355932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f37a8-0288-45c0-8d31-63a3b5e4aaf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:44.358003 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f37a8-0288-45c0-8d31-63a3b5e4aaf2 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:44.360930 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3f335-2649-446d-aa47-6c52c52353a1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:44.402431 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf316e63-fd42-48e0-baac-cbe549347a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:44.403346 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf316e63-fd42-48e0-baac-cbe549347a62 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:44.403940 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf316e63-fd42-48e0-baac-cbe549347a62 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:44.404528 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf316e63-fd42-48e0-baac-cbe549347a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:44.405417 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf316e63-fd42-48e0-baac-cbe549347a62 None admin] RBAC: Adding query filter params (group.id=d386962cc5c342bb80fc641fdbb71f37, role.id=807b71faee4a435e95e2ca3296e64c2e, scope.project.id=a37fe08aba474a1bb58912f977979b86) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:44.405891 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf316e63-fd42-48e0-baac-cbe549347a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:44.407519 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf316e63-fd42-48e0-baac-cbe549347a62 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:44.416933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 227/445] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 31 14:53:44 2022] GET /identity/v3/role_assignments?group.id=d386962cc5c342bb80fc641fdbb71f37&scope.project.id=a37fe08aba474a1bb58912f977979b86&role.id=807b71faee4a435e95e2ca3296e64c2e => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:44.417613 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf316e63-fd42-48e0-baac-cbe549347a62 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:44.434531 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:44.449743 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:44.480537 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 219/446] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:44.486840 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f37a8-0288-45c0-8d31-63a3b5e4aaf2 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:44.536669 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf316e63-fd42-48e0-baac-cbe549347a62 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:44.576789 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ca97f-f8b4-4f03-b3e1-b8a98bb99550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:44.577439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ca97f-f8b4-4f03-b3e1-b8a98bb99550 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:44.577723 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ca97f-f8b4-4f03-b3e1-b8a98bb99550 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:44.578000 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ca97f-f8b4-4f03-b3e1-b8a98bb99550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:44.590190 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ca97f-f8b4-4f03-b3e1-b8a98bb99550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-819ca97f-f8b4-4f03-b3e1-b8a98bb99550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:44.595331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:44.596385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:44.597301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 228/447] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:53:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:44.602989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ca97f-f8b4-4f03-b3e1-b8a98bb99550 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:44.603994 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f37a8-0288-45c0-8d31-63a3b5e4aaf2 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:44.648284 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997381c-a072-4c42-8751-c75f9f7546d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:44.650004 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997381c-a072-4c42-8751-c75f9f7546d6 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:44.650282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997381c-a072-4c42-8751-c75f9f7546d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:44.650584 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997381c-a072-4c42-8751-c75f9f7546d6 None admin] PATH_INFO: `/v3/projects/a37fe08aba474a1bb58912f977979b86` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:44.652198 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997381c-a072-4c42-8751-c75f9f7546d6 None admin] RBAC: Authorizing `identity:get_project(project_id=a37fe08aba474a1bb58912f977979b86)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:44.653554 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997381c-a072-4c42-8751-c75f9f7546d6 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:44.655411 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 220/448] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:44 2022] GET /identity/v3/projects/a37fe08aba474a1bb58912f977979b86 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:44.661038 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997381c-a072-4c42-8751-c75f9f7546d6 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:44.695868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:44.703593 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:44.720396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ca97f-f8b4-4f03-b3e1-b8a98bb99550 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:44.767173 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2feba-a480-4c83-953f-4e70c6ab106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:44.767786 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2feba-a480-4c83-953f-4e70c6ab106d None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:44.768213 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2feba-a480-4c83-953f-4e70c6ab106d None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:44.768484 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2feba-a480-4c83-953f-4e70c6ab106d None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:44.769630 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2feba-a480-4c83-953f-4e70c6ab106d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:44.770067 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2feba-a480-4c83-953f-4e70c6ab106d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:44.771986 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2feba-a480-4c83-953f-4e70c6ab106d None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:44.778961 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997381c-a072-4c42-8751-c75f9f7546d6 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:44.781156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 229/449] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:44.786808 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2feba-a480-4c83-953f-4e70c6ab106d None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:44.823819 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5060e05-77de-4334-acec-9540bbe540f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:44.824455 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5060e05-77de-4334-acec-9540bbe540f4 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:44.824730 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5060e05-77de-4334-acec-9540bbe540f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:44.824998 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5060e05-77de-4334-acec-9540bbe540f4 None admin] PATH_INFO: `/v3/groups/d386962cc5c342bb80fc641fdbb71f37` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:44.826127 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5060e05-77de-4334-acec-9540bbe540f4 None admin] RBAC: Authorizing `identity:get_group(group_id=d386962cc5c342bb80fc641fdbb71f37)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:44.827581 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5060e05-77de-4334-acec-9540bbe540f4 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:44.829251 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 221/450] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:44 2022] GET /identity/v3/groups/d386962cc5c342bb80fc641fdbb71f37 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:44.835507 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5060e05-77de-4334-acec-9540bbe540f4 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:44.900965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2feba-a480-4c83-953f-4e70c6ab106d None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:44.933997 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:44.934853 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a080a0d-ac56-4d06-84f4-a0e171235662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:44.935512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a080a0d-ac56-4d06-84f4-a0e171235662 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:44.935876 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a080a0d-ac56-4d06-84f4-a0e171235662 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:44.936145 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a080a0d-ac56-4d06-84f4-a0e171235662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:44.937937 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5060e05-77de-4334-acec-9540bbe540f4 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:44.953854 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:44.974784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec150b6-31c3-4cb5-b723-9edbebe3cb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:44.975396 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec150b6-31c3-4cb5-b723-9edbebe3cb83 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:44.975680 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec150b6-31c3-4cb5-b723-9edbebe3cb83 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:44.975953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec150b6-31c3-4cb5-b723-9edbebe3cb83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:44.976694 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec150b6-31c3-4cb5-b723-9edbebe3cb83 None admin] RBAC: Adding query filter params (group.id=d386962cc5c342bb80fc641fdbb71f37, role.id=a3a5839e9bda47d8af7a7b707f7a9888, scope.project.id=a37fe08aba474a1bb58912f977979b86) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:44.977514 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec150b6-31c3-4cb5-b723-9edbebe3cb83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:44.979049 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec150b6-31c3-4cb5-b723-9edbebe3cb83 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:44.985155 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 222/451] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 31 14:53:44 2022] GET /identity/v3/role_assignments?group.id=d386962cc5c342bb80fc641fdbb71f37&scope.project.id=a37fe08aba474a1bb58912f977979b86&role.id=a3a5839e9bda47d8af7a7b707f7a9888 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:53:45.008743 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a080a0d-ac56-4d06-84f4-a0e171235662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:45.010286 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a080a0d-ac56-4d06-84f4-a0e171235662 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:45.119062 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 230/452] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 14:53:45.124975 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec150b6-31c3-4cb5-b723-9edbebe3cb83 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:45.229464 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec150b6-31c3-4cb5-b723-9edbebe3cb83 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:45.264533 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f345878-4641-4638-93a0-b472467fff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:45.265158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f345878-4641-4638-93a0-b472467fff50 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:45.265435 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f345878-4641-4638-93a0-b472467fff50 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:45.265700 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f345878-4641-4638-93a0-b472467fff50 None admin] PATH_INFO: `/v3/projects/b905fa215ef84f989a1edb29db9488aa` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:45.266862 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f345878-4641-4638-93a0-b472467fff50 None admin] RBAC: Authorizing `identity:get_project(project_id=b905fa215ef84f989a1edb29db9488aa)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:45.268292 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f345878-4641-4638-93a0-b472467fff50 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:45.269899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 223/453] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 31 14:53:45 2022] GET /identity/v3/projects/b905fa215ef84f989a1edb29db9488aa => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:45.276297 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a080a0d-ac56-4d06-84f4-a0e171235662 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:45.325854 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:45.377903 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a080a0d-ac56-4d06-84f4-a0e171235662 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:45.412208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d53fb4-0395-4c23-b5be-53b1ba7b4a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:45.412827 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d53fb4-0395-4c23-b5be-53b1ba7b4a00 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:45.413107 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d53fb4-0395-4c23-b5be-53b1ba7b4a00 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:45.413378 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d53fb4-0395-4c23-b5be-53b1ba7b4a00 None admin] PATH_INFO: `/v3/groups/fb2d751aa55d4caea12b2f6eb256eafc` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:45.414560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d53fb4-0395-4c23-b5be-53b1ba7b4a00 None admin] RBAC: Authorizing `identity:get_group(group_id=fb2d751aa55d4caea12b2f6eb256eafc)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:45.415996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d53fb4-0395-4c23-b5be-53b1ba7b4a00 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:45.417541 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 231/454] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 31 14:53:45 2022] GET /identity/v3/groups/fb2d751aa55d4caea12b2f6eb256eafc => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:45.423650 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f345878-4641-4638-93a0-b472467fff50 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:45.455139 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:45.521609 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f345878-4641-4638-93a0-b472467fff50 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:45.554033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603c074-8996-4a91-b9d2-4cb90c60b437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:45.554646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c074-8996-4a91-b9d2-4cb90c60b437 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:45.554950 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c074-8996-4a91-b9d2-4cb90c60b437 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:45.555218 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c074-8996-4a91-b9d2-4cb90c60b437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:45.556017 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603c074-8996-4a91-b9d2-4cb90c60b437 None admin] RBAC: Adding query filter params (group.id=fb2d751aa55d4caea12b2f6eb256eafc, role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4, scope.project.id=b905fa215ef84f989a1edb29db9488aa) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:45.556320 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603c074-8996-4a91-b9d2-4cb90c60b437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:45.557706 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603c074-8996-4a91-b9d2-4cb90c60b437 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:45.563194 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 224/455] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 31 14:53:45 2022] GET /identity/v3/role_assignments?group.id=fb2d751aa55d4caea12b2f6eb256eafc&scope.project.id=b905fa215ef84f989a1edb29db9488aa&role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:48.243277 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485a012-1462-44e1-9bb8-42d0b79a0d78 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:48.243809 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485a012-1462-44e1-9bb8-42d0b79a0d78 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:48.243809 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485a012-1462-44e1-9bb8-42d0b79a0d78 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:48.245434 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 232/456] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:48.250785 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba73aec-9c5a-4e46-a3f8-1e3ed58671a0 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:48.251182 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba73aec-9c5a-4e46-a3f8-1e3ed58671a0 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:48.251336 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba73aec-9c5a-4e46-a3f8-1e3ed58671a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:48.270749 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-5ba73aec-9c5a-4e46-a3f8-1e3ed58671a0 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:48.271949 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-5ba73aec-9c5a-4e46-a3f8-1e3ed58671a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:48.347452 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 225/457] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:48.559295 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b47ba-8513-42e0-8fd4-4bb01aa56e53 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:48.559635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b47ba-8513-42e0-8fd4-4bb01aa56e53 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:48.559760 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b47ba-8513-42e0-8fd4-4bb01aa56e53 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:48.561528 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 233/458] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:48.567569 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba56cc7-f2b0-493a-9aaa-a732020ff1c0 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:48.568213 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba56cc7-f2b0-493a-9aaa-a732020ff1c0 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:48.568694 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba56cc7-f2b0-493a-9aaa-a732020ff1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:48.588886 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-9ba56cc7-f2b0-493a-9aaa-a732020ff1c0 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:48.590499 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-9ba56cc7-f2b0-493a-9aaa-a732020ff1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:48.610274 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:48.663551 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 226/459] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:48.684583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b47ba-8513-42e0-8fd4-4bb01aa56e53 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:48.747064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd5e7f-344e-4a1c-815f-ec196aa6fbcc None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:48.747704 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd5e7f-344e-4a1c-815f-ec196aa6fbcc None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:48.748169 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd5e7f-344e-4a1c-815f-ec196aa6fbcc None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:48.749964 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 227/460] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:53:48.754811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80227c85-813d-40d3-94b8-124613cb6360 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:48.755191 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80227c85-813d-40d3-94b8-124613cb6360 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:48.755469 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80227c85-813d-40d3-94b8-124613cb6360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:48.778846 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-80227c85-813d-40d3-94b8-124613cb6360 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:48.780050 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-80227c85-813d-40d3-94b8-124613cb6360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:48.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b47ba-8513-42e0-8fd4-4bb01aa56e53 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:48.816195 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:48.843117 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432b866-47c7-49fe-a186-d583ad68571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:48.850051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432b866-47c7-49fe-a186-d583ad68571e None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:48.850971 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432b866-47c7-49fe-a186-d583ad68571e None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:48.851506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432b866-47c7-49fe-a186-d583ad68571e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:48.865880 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432b866-47c7-49fe-a186-d583ad68571e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:48.868400 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432b866-47c7-49fe-a186-d583ad68571e None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:48.870372 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 228/461] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-0432b866-47c7-49fe-a186-d583ad68571e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:48.892493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:48.893462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:48.894334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:48.894334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:48.894334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:48.896156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 234/462] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:48.903099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80227c85-813d-40d3-94b8-124613cb6360 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:48.991965 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:49.009066 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80227c85-813d-40d3-94b8-124613cb6360 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:49.014984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432b866-47c7-49fe-a186-d583ad68571e None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:49.046856 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f66b6-7857-4e2c-985f-c6f1dd42e065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:49.047468 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f66b6-7857-4e2c-985f-c6f1dd42e065 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:49.047747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f66b6-7857-4e2c-985f-c6f1dd42e065 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:49.048017 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f66b6-7857-4e2c-985f-c6f1dd42e065 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:49.048652 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f66b6-7857-4e2c-985f-c6f1dd42e065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:49.048949 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f66b6-7857-4e2c-985f-c6f1dd42e065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:49.050611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f66b6-7857-4e2c-985f-c6f1dd42e065 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:49.063080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 229/463] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:49.064397 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa28c14-69ab-4d0f-a80d-456488c6ed2b None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:49.064680 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa28c14-69ab-4d0f-a80d-456488c6ed2b None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:49.064953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa28c14-69ab-4d0f-a80d-456488c6ed2b None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:49.070962 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 230/464] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:49.070962 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa28c14-69ab-4d0f-a80d-456488c6ed2b None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:49.133573 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432b866-47c7-49fe-a186-d583ad68571e None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:49.170560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6546f-deec-4d18-a6b0-0258be8ba697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:49.171588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6546f-deec-4d18-a6b0-0258be8ba697 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:49.172122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6546f-deec-4d18-a6b0-0258be8ba697 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:49.172561 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6546f-deec-4d18-a6b0-0258be8ba697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:49.178277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa28c14-69ab-4d0f-a80d-456488c6ed2b None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:49.185576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6546f-deec-4d18-a6b0-0258be8ba697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:49.187066 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6546f-deec-4d18-a6b0-0258be8ba697 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-02e6546f-deec-4d18-a6b0-0258be8ba697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:49.202596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:49.203691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:49.205023 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:49.205023 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:49.205023 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:49.205023 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 235/465] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:49.209767 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497fb3-1a02-471e-9c71-6e14c18d3a11 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:49.210166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497fb3-1a02-471e-9c71-6e14c18d3a11 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:49.210470 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497fb3-1a02-471e-9c71-6e14c18d3a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:49.215098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aa37d-2ff5-4485-8a95-cd9169b12a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:49.215707 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aa37d-2ff5-4485-8a95-cd9169b12a6c None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:49.215986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aa37d-2ff5-4485-8a95-cd9169b12a6c None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:49.216258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aa37d-2ff5-4485-8a95-cd9169b12a6c None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:49.216900 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549aa37d-2ff5-4485-8a95-cd9169b12a6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:49.218330 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549aa37d-2ff5-4485-8a95-cd9169b12a6c None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:49.228558 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-25497fb3-1a02-471e-9c71-6e14c18d3a11 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:49.229941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-25497fb3-1a02-471e-9c71-6e14c18d3a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:49.245080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:49.295684 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 236/466] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:49.296479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25497fb3-1a02-471e-9c71-6e14c18d3a11 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:49.310146 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:49.315384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 231/467] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 31 14:53:49 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:53:49.328853 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aa37d-2ff5-4485-8a95-cd9169b12a6c None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:49.442097 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25497fb3-1a02-471e-9c71-6e14c18d3a11 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:49.453232 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aa37d-2ff5-4485-8a95-cd9169b12a6c None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:49.482354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac506db-3e54-406b-b661-805cce45b3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:49.483496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac506db-3e54-406b-b661-805cce45b3aa None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:49.483984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac506db-3e54-406b-b661-805cce45b3aa None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:49.484392 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac506db-3e54-406b-b661-805cce45b3aa None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:49.485178 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac506db-3e54-406b-b661-805cce45b3aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:49.485643 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac506db-3e54-406b-b661-805cce45b3aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:49.487408 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac506db-3e54-406b-b661-805cce45b3aa None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:49.507080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 237/468] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:49.508751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a5614-32cc-46e8-b34f-0adb4d14390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:49.509232 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac506db-3e54-406b-b661-805cce45b3aa None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:49.509425 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a5614-32cc-46e8-b34f-0adb4d14390c None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:49.509651 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a5614-32cc-46e8-b34f-0adb4d14390c None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:49.509917 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a5614-32cc-46e8-b34f-0adb4d14390c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:49.522869 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a5614-32cc-46e8-b34f-0adb4d14390c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:49.523917 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:49.525089 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a5614-32cc-46e8-b34f-0adb4d14390c None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-505a5614-32cc-46e8-b34f-0adb4d14390c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:49.543541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:49.544505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:49.545356 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:49.545356 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:49.545356 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:49.545356 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 232/469] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:49.551829 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a5614-32cc-46e8-b34f-0adb4d14390c None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:49.614788 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:49.631316 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac506db-3e54-406b-b661-805cce45b3aa None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:49.659490 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a5614-32cc-46e8-b34f-0adb4d14390c None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:49.668471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2da33-754d-49b0-a201-57c1034ae914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:49.669166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2da33-754d-49b0-a201-57c1034ae914 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:49.669447 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2da33-754d-49b0-a201-57c1034ae914 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:49.669715 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2da33-754d-49b0-a201-57c1034ae914 None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:49.670388 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2da33-754d-49b0-a201-57c1034ae914 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:49.671819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2da33-754d-49b0-a201-57c1034ae914 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:49.696841 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46ec8a-9993-4fce-8039-9e35eff534a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:49.697541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46ec8a-9993-4fce-8039-9e35eff534a6 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:49.697891 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46ec8a-9993-4fce-8039-9e35eff534a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:49.698232 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46ec8a-9993-4fce-8039-9e35eff534a6 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:49.698964 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46ec8a-9993-4fce-8039-9e35eff534a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:49.699336 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46ec8a-9993-4fce-8039-9e35eff534a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:49.700761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46ec8a-9993-4fce-8039-9e35eff534a6 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:49.712932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 233/470] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:49.715191 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46ec8a-9993-4fce-8039-9e35eff534a6 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:49.757310 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 238/471] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 31 14:53:49 2022] POST /identity/v3/users => generated 246 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:53:49.757310 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2da33-754d-49b0-a201-57c1034ae914 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:49.843640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46ec8a-9993-4fce-8039-9e35eff534a6 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:49.863628 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:49.879868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:49.899174 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2da33-754d-49b0-a201-57c1034ae914 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:49.904062 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b93af7-9f2e-4b7d-9e5a-d15cceb1322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:49.904725 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b93af7-9f2e-4b7d-9e5a-d15cceb1322c None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:49.905004 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b93af7-9f2e-4b7d-9e5a-d15cceb1322c None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:49.911994 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b93af7-9f2e-4b7d-9e5a-d15cceb1322c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:49.918630 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b93af7-9f2e-4b7d-9e5a-d15cceb1322c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:49.920110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b93af7-9f2e-4b7d-9e5a-d15cceb1322c None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-c6b93af7-9f2e-4b7d-9e5a-d15cceb1322c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:49.938087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:49.943954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:49.944797 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:49.944797 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:49.944797 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:49.944797 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 234/472] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:49.946753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354e959-2229-49b5-bfc6-b16e524670a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:49.947375 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354e959-2229-49b5-bfc6-b16e524670a8 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:49.947653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354e959-2229-49b5-bfc6-b16e524670a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:49.947925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354e959-2229-49b5-bfc6-b16e524670a8 None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:49.948125 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b93af7-9f2e-4b7d-9e5a-d15cceb1322c None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:49.948573 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354e959-2229-49b5-bfc6-b16e524670a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:49.950135 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354e959-2229-49b5-bfc6-b16e524670a8 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:50.039868 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 239/473] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 31 14:53:49 2022] POST /identity/v3/users => generated 249 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:53:50.078199 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b93af7-9f2e-4b7d-9e5a-d15cceb1322c None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:50.120723 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86383509-2e6b-4cbc-aadf-c6cc3137c2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:50.121402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86383509-2e6b-4cbc-aadf-c6cc3137c2cc None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:50.121684 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86383509-2e6b-4cbc-aadf-c6cc3137c2cc None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:50.122074 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86383509-2e6b-4cbc-aadf-c6cc3137c2cc None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:50.122819 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86383509-2e6b-4cbc-aadf-c6cc3137c2cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:50.123172 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86383509-2e6b-4cbc-aadf-c6cc3137c2cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:50.124608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86383509-2e6b-4cbc-aadf-c6cc3137c2cc None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:50.139711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 235/474] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:50.145283 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354e959-2229-49b5-bfc6-b16e524670a8 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:50.264855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354e959-2229-49b5-bfc6-b16e524670a8 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:50.291993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:50.304474 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c97dc8-a479-4feb-86f4-710f3e6b1bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:50.305319 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c97dc8-a479-4feb-86f4-710f3e6b1bbb None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:50.305821 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c97dc8-a479-4feb-86f4-710f3e6b1bbb None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:50.306106 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c97dc8-a479-4feb-86f4-710f3e6b1bbb None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:50.306793 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c97dc8-a479-4feb-86f4-710f3e6b1bbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:50.308312 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c97dc8-a479-4feb-86f4-710f3e6b1bbb None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:50.424139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 240/475] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 31 14:53:50 2022] POST /identity/v3/users => generated 248 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:53:51.660646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28459622-5cea-4771-bc98-d7594f61b262 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:51.661166 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28459622-5cea-4771-bc98-d7594f61b262 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:51.661468 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28459622-5cea-4771-bc98-d7594f61b262 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:51.663023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 236/476] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:51.668947 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121d2c8-f433-44d6-987a-bc82bcaddb83 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:51.669361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121d2c8-f433-44d6-987a-bc82bcaddb83 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:51.669531 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121d2c8-f433-44d6-987a-bc82bcaddb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:51.688668 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-e121d2c8-f433-44d6-987a-bc82bcaddb83 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:51.689864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-e121d2c8-f433-44d6-987a-bc82bcaddb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:51.770499 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 241/477] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:52.073324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b95df-84ad-4704-9cb5-fd6c8187a55c None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:52.073545 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b95df-84ad-4704-9cb5-fd6c8187a55c None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:52.073905 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b95df-84ad-4704-9cb5-fd6c8187a55c None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:52.075280 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 237/478] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:52.081128 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d557b0-0647-4680-8212-e267e35951ae None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:52.081422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d557b0-0647-4680-8212-e267e35951ae None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:52.081670 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d557b0-0647-4680-8212-e267e35951ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:52.108588 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b95df-84ad-4704-9cb5-fd6c8187a55c None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:52.110119 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-95d557b0-0647-4680-8212-e267e35951ae None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:52.111702 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-95d557b0-0647-4680-8212-e267e35951ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:52.150711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:52.215845 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 242/479] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:52.271882 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b95df-84ad-4704-9cb5-fd6c8187a55c None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:52.315524 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22a08d-154d-43b9-9896-44a5d4e6a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:52.317937 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22a08d-154d-43b9-9896-44a5d4e6a311 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:52.318241 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22a08d-154d-43b9-9896-44a5d4e6a311 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:52.318541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22a08d-154d-43b9-9896-44a5d4e6a311 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:52.343335 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22a08d-154d-43b9-9896-44a5d4e6a311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-ad22a08d-154d-43b9-9896-44a5d4e6a311 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:52.348248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:52.349145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:52.349955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:52.349955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:52.349955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:52.349955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:52.349955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:52.349955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:52.349955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:52.349955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:52.349955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:52.349955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:52.349955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:53:52.349955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:52.350634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 238/480] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:53:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:52.364962 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d557b0-0647-4680-8212-e267e35951ae None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:52.421785 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:52.481938 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e6f86-9fe6-44ec-b2b9-fd82fe79fb86 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:52.482272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e6f86-9fe6-44ec-b2b9-fd82fe79fb86 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:52.482644 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e6f86-9fe6-44ec-b2b9-fd82fe79fb86 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:52.484532 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 239/481] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:53:52.489148 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813127b-891e-4dbe-8212-47dad55acd20 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:52.489427 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813127b-891e-4dbe-8212-47dad55acd20 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:52.489700 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813127b-891e-4dbe-8212-47dad55acd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:52.506010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d557b0-0647-4680-8212-e267e35951ae None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:52.521635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-e813127b-891e-4dbe-8212-47dad55acd20 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:52.524701 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-e813127b-891e-4dbe-8212-47dad55acd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:52.567409 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608d1f6-acab-4746-a8f2-b46714adb485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:52.568027 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608d1f6-acab-4746-a8f2-b46714adb485 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:52.568306 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608d1f6-acab-4746-a8f2-b46714adb485 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:52.568578 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608d1f6-acab-4746-a8f2-b46714adb485 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:52.569251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608d1f6-acab-4746-a8f2-b46714adb485 None admin] RBAC: Adding query filter params (name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:52.569554 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608d1f6-acab-4746-a8f2-b46714adb485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:52.575100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608d1f6-acab-4746-a8f2-b46714adb485 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:52.594407 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 243/482] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:53:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:52.606325 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608d1f6-acab-4746-a8f2-b46714adb485 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:52.643916 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 240/483] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:53:52.645268 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813127b-891e-4dbe-8212-47dad55acd20 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:52.678323 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:52.763221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:52.766066 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608d1f6-acab-4746-a8f2-b46714adb485 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:52.802670 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9e7b6-00ec-4f43-b86f-1aca4bcdd5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:52.803330 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9e7b6-00ec-4f43-b86f-1aca4bcdd5ed None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:52.803609 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9e7b6-00ec-4f43-b86f-1aca4bcdd5ed None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:52.803884 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9e7b6-00ec-4f43-b86f-1aca4bcdd5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:52.807444 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813127b-891e-4dbe-8212-47dad55acd20 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:52.814263 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9e7b6-00ec-4f43-b86f-1aca4bcdd5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:52.816164 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9e7b6-00ec-4f43-b86f-1aca4bcdd5ed None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-00d9e7b6-00ec-4f43-b86f-1aca4bcdd5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:52.832218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:52.833155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:52.834337 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:52.834337 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:52.834337 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:52.834337 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 244/484] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:52.834636 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8859a95-3e4b-40ec-bdaf-87578e310807 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:52.834713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8859a95-3e4b-40ec-bdaf-87578e310807 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:52.834983 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8859a95-3e4b-40ec-bdaf-87578e310807 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:52.836982 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 245/485] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:52.841724 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8859a95-3e4b-40ec-bdaf-87578e310807 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:52.854593 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdf76a-e454-48b1-a2d3-2213d808eec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:52.855239 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdf76a-e454-48b1-a2d3-2213d808eec5 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:52.855525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdf76a-e454-48b1-a2d3-2213d808eec5 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:52.855802 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdf76a-e454-48b1-a2d3-2213d808eec5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:52.867020 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdf76a-e454-48b1-a2d3-2213d808eec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-0acdf76a-e454-48b1-a2d3-2213d808eec5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:52.872861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:52.873954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:52.875052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 241/486] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:53:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:52.875744 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8017e9a-c0f7-4c21-8a6d-ca8e70eba529 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:52.875744 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8017e9a-c0f7-4c21-8a6d-ca8e70eba529 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:52.875965 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8017e9a-c0f7-4c21-8a6d-ca8e70eba529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:52.894004 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-f8017e9a-c0f7-4c21-8a6d-ca8e70eba529 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:52.895586 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-f8017e9a-c0f7-4c21-8a6d-ca8e70eba529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:52.960120 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8859a95-3e4b-40ec-bdaf-87578e310807 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:52.970341 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 242/487] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:52.970341 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8017e9a-c0f7-4c21-8a6d-ca8e70eba529 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:52.979542 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:53.004597 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4731b48-43a8-4713-8a3d-c7ed84db3ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.005208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4731b48-43a8-4713-8a3d-c7ed84db3ccf None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.005488 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4731b48-43a8-4713-8a3d-c7ed84db3ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.005758 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4731b48-43a8-4713-8a3d-c7ed84db3ccf None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.006433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4731b48-43a8-4713-8a3d-c7ed84db3ccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:53.006735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4731b48-43a8-4713-8a3d-c7ed84db3ccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:53.009236 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4731b48-43a8-4713-8a3d-c7ed84db3ccf None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:53.026282 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 246/488] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:53.026282 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4731b48-43a8-4713-8a3d-c7ed84db3ccf None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:53.040197 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:53.092956 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8017e9a-c0f7-4c21-8a6d-ca8e70eba529 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:53.132043 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da5d14-26c2-4367-b2ac-ac5914f0c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.132573 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da5d14-26c2-4367-b2ac-ac5914f0c0ed None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.132896 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da5d14-26c2-4367-b2ac-ac5914f0c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.133528 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4731b48-43a8-4713-8a3d-c7ed84db3ccf None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:53.134315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da5d14-26c2-4367-b2ac-ac5914f0c0ed None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.134999 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da5d14-26c2-4367-b2ac-ac5914f0c0ed None admin] RBAC: Adding query filter params (name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:53.135304 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da5d14-26c2-4367-b2ac-ac5914f0c0ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:53.136794 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da5d14-26c2-4367-b2ac-ac5914f0c0ed None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:53.146341 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 243/489] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:53:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:53.146341 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da5d14-26c2-4367-b2ac-ac5914f0c0ed None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:53.173693 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac228d2-3676-4f5f-843d-0bf904bfac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.174356 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac228d2-3676-4f5f-843d-0bf904bfac87 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.174698 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac228d2-3676-4f5f-843d-0bf904bfac87 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.174979 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac228d2-3676-4f5f-843d-0bf904bfac87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.187711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac228d2-3676-4f5f-843d-0bf904bfac87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-8ac228d2-3676-4f5f-843d-0bf904bfac87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:53.192482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:53.193391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:53.194181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 247/490] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:53:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:53.194887 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac228d2-3676-4f5f-843d-0bf904bfac87 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:53.226241 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:53.265112 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da5d14-26c2-4367-b2ac-ac5914f0c0ed None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:53.275857 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:53.303395 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2896ec-a577-4ec5-ae63-384cc75823cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.304018 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2896ec-a577-4ec5-ae63-384cc75823cc None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.304295 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2896ec-a577-4ec5-ae63-384cc75823cc None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.304566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2896ec-a577-4ec5-ae63-384cc75823cc None admin] PATH_INFO: `/v3/users/glance` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.308030 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac228d2-3676-4f5f-843d-0bf904bfac87 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:53.312599 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2896ec-a577-4ec5-ae63-384cc75823cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:53.314041 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2896ec-a577-4ec5-ae63-384cc75823cc None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-fd2896ec-a577-4ec5-ae63-384cc75823cc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:53:53.327253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:53.328193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:53.329128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:53.329128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:53.329128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:53:53.329128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:53:53.329128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:53:53.329128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:53:53.329128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:53:53.329128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:53:53.329128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 14:53:53.329128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:53.329128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 244/491] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:53.329716 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2896ec-a577-4ec5-ae63-384cc75823cc None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:53.345009 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641ad65-f445-4214-baa1-b575c13f1150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.345641 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641ad65-f445-4214-baa1-b575c13f1150 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.345921 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641ad65-f445-4214-baa1-b575c13f1150 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.346193 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641ad65-f445-4214-baa1-b575c13f1150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.356456 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641ad65-f445-4214-baa1-b575c13f1150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:53.358175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641ad65-f445-4214-baa1-b575c13f1150 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-1641ad65-f445-4214-baa1-b575c13f1150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:53.372676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:53.373600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:53.374891 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:53.374891 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:53.374891 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:53.374891 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 248/492] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:53.374891 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641ad65-f445-4214-baa1-b575c13f1150 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:53.431964 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2896ec-a577-4ec5-ae63-384cc75823cc None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:53.457256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:53.465917 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870a5c7-f8a5-488a-820c-22a8c9074b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.466566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870a5c7-f8a5-488a-820c-22a8c9074b7a None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.466842 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870a5c7-f8a5-488a-820c-22a8c9074b7a None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.467111 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870a5c7-f8a5-488a-820c-22a8c9074b7a None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.467988 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870a5c7-f8a5-488a-820c-22a8c9074b7a None admin] RBAC: Adding query filter params (name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:53.468089 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870a5c7-f8a5-488a-820c-22a8c9074b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:53.469396 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870a5c7-f8a5-488a-820c-22a8c9074b7a None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:53.473645 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641ad65-f445-4214-baa1-b575c13f1150 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:53.480868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 245/493] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:53:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:53.480868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870a5c7-f8a5-488a-820c-22a8c9074b7a None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:53.498732 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:53.509403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ef5a-9656-43a3-8d93-8a58c2591307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.510112 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ef5a-9656-43a3-8d93-8a58c2591307 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.510499 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ef5a-9656-43a3-8d93-8a58c2591307 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.510783 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ef5a-9656-43a3-8d93-8a58c2591307 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.521385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084ef5a-9656-43a3-8d93-8a58c2591307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-f084ef5a-9656-43a3-8d93-8a58c2591307 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:53.526792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:53.527819 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 249/494] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:53:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:53.528753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ef5a-9656-43a3-8d93-8a58c2591307 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:53.588387 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870a5c7-f8a5-488a-820c-22a8c9074b7a None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:53.622824 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b89b1-7fd3-4ada-be2a-fe4e38d3d759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.623438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b89b1-7fd3-4ada-be2a-fe4e38d3d759 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.623716 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b89b1-7fd3-4ada-be2a-fe4e38d3d759 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.623988 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b89b1-7fd3-4ada-be2a-fe4e38d3d759 None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.624714 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b89b1-7fd3-4ada-be2a-fe4e38d3d759 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:53.625020 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b89b1-7fd3-4ada-be2a-fe4e38d3d759 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:53.626116 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ef5a-9656-43a3-8d93-8a58c2591307 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:53.626471 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b89b1-7fd3-4ada-be2a-fe4e38d3d759 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:53.659477 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38956338-e118-4bca-b7fa-65cc3660add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.660076 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38956338-e118-4bca-b7fa-65cc3660add0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.660351 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38956338-e118-4bca-b7fa-65cc3660add0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.660622 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38956338-e118-4bca-b7fa-65cc3660add0 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.661249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38956338-e118-4bca-b7fa-65cc3660add0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:53.661547 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38956338-e118-4bca-b7fa-65cc3660add0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:53.662886 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 246/495] 10.222.0.52 () {56 vars in 1137 bytes} [Wed Aug 31 14:53:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:53.663002 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38956338-e118-4bca-b7fa-65cc3660add0 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:53.663715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b89b1-7fd3-4ada-be2a-fe4e38d3d759 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:53.679914 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 250/496] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:53.679914 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38956338-e118-4bca-b7fa-65cc3660add0 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:53.712010 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:53.724151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:53.765973 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b89b1-7fd3-4ada-be2a-fe4e38d3d759 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:53.779330 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38956338-e118-4bca-b7fa-65cc3660add0 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:53.801239 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508e311-4e3c-460e-9ec2-985c1439f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.801870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508e311-4e3c-460e-9ec2-985c1439f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.802148 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508e311-4e3c-460e-9ec2-985c1439f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.802452 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508e311-4e3c-460e-9ec2-985c1439f4a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.813342 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508e311-4e3c-460e-9ec2-985c1439f4a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:53.814829 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508e311-4e3c-460e-9ec2-985c1439f4a0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:53.816433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a5fe9-2ca6-475a-b82d-61bf2c28f3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.817037 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a5fe9-2ca6-475a-b82d-61bf2c28f3a9 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.817321 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a5fe9-2ca6-475a-b82d-61bf2c28f3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.817596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a5fe9-2ca6-475a-b82d-61bf2c28f3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.818253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a5fe9-2ca6-475a-b82d-61bf2c28f3a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:53.818588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a5fe9-2ca6-475a-b82d-61bf2c28f3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:53.819947 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a5fe9-2ca6-475a-b82d-61bf2c28f3a9 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:53.828152 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 251/497] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:53:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:53.828937 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a5fe9-2ca6-475a-b82d-61bf2c28f3a9 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-4508e311-4e3c-460e-9ec2-985c1439f4a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:53.829281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:53.830367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:53.831277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:53.831277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:53.831277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:53.831277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 247/498] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:53.832852 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508e311-4e3c-460e-9ec2-985c1439f4a0 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:53.928823 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:53.931661 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a5fe9-2ca6-475a-b82d-61bf2c28f3a9 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:53.932838 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508e311-4e3c-460e-9ec2-985c1439f4a0 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:53.938527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:53.965285 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc2130-3a7d-40b3-9869-303b3684234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.965830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc2130-3a7d-40b3-9869-303b3684234c None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.966111 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be73de-b158-44e9-a6dd-375a301482bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:53.966230 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc2130-3a7d-40b3-9869-303b3684234c None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.970201 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc2130-3a7d-40b3-9869-303b3684234c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.970325 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be73de-b158-44e9-a6dd-375a301482bd None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:53.970325 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be73de-b158-44e9-a6dd-375a301482bd None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:53.970325 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be73de-b158-44e9-a6dd-375a301482bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:53.974221 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be73de-b158-44e9-a6dd-375a301482bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:53.975733 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be73de-b158-44e9-a6dd-375a301482bd None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-a4be73de-b158-44e9-a6dd-375a301482bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:53:53.987740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:53.993813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:53.994985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:53.994985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:53.994985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:53:53.994985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:53:53.994985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:53:53.994985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:53:53.994985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:53:53.994985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:53:53.994985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 14:53:53.994985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:53.994985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 248/499] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 31 14:53:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:53.994985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be73de-b158-44e9-a6dd-375a301482bd None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:54.039776 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc2130-3a7d-40b3-9869-303b3684234c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:54.041240 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc2130-3a7d-40b3-9869-303b3684234c None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:54.091532 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be73de-b158-44e9-a6dd-375a301482bd None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:54.124974 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e06b2f-7fd1-4f59-a4d7-09c8fa85ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:54.125588 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e06b2f-7fd1-4f59-a4d7-09c8fa85ef31 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:54.125863 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e06b2f-7fd1-4f59-a4d7-09c8fa85ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:54.126130 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e06b2f-7fd1-4f59-a4d7-09c8fa85ef31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:54.136985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e06b2f-7fd1-4f59-a4d7-09c8fa85ef31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:54.138478 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e06b2f-7fd1-4f59-a4d7-09c8fa85ef31 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:54.139939 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 252/500] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:54.140802 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc2130-3a7d-40b3-9869-303b3684234c None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:54.149844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-07e06b2f-7fd1-4f59-a4d7-09c8fa85ef31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:54.154099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:54.155306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:54.156387 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:54.156387 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:54.156387 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:54.158440 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 249/501] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:54.159363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e06b2f-7fd1-4f59-a4d7-09c8fa85ef31 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:54.171430 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:54.242387 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc2130-3a7d-40b3-9869-303b3684234c None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:54.258586 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e06b2f-7fd1-4f59-a4d7-09c8fa85ef31 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:54.278627 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b656024-8e5e-4752-8c18-ba65545167a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:54.279227 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b656024-8e5e-4752-8c18-ba65545167a2 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:54.279504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b656024-8e5e-4752-8c18-ba65545167a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:54.279772 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b656024-8e5e-4752-8c18-ba65545167a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:54.280406 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b656024-8e5e-4752-8c18-ba65545167a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:54.280704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b656024-8e5e-4752-8c18-ba65545167a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:54.282069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b656024-8e5e-4752-8c18-ba65545167a2 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:54.291509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfafc27-fc07-46c2-891f-50f0650d9abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:54.292102 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfafc27-fc07-46c2-891f-50f0650d9abf None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:54.292378 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfafc27-fc07-46c2-891f-50f0650d9abf None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:54.292647 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfafc27-fc07-46c2-891f-50f0650d9abf None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:54.293365 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfafc27-fc07-46c2-891f-50f0650d9abf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:54.297949 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 253/502] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:54.298062 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfafc27-fc07-46c2-891f-50f0650d9abf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:54.298146 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b656024-8e5e-4752-8c18-ba65545167a2 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:54.298247 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfafc27-fc07-46c2-891f-50f0650d9abf None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:54.312712 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 250/503] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 31 14:53:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:54.313623 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfafc27-fc07-46c2-891f-50f0650d9abf None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:54.359996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:54.380647 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:54.394770 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b656024-8e5e-4752-8c18-ba65545167a2 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:54.412657 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfafc27-fc07-46c2-891f-50f0650d9abf None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:54.429824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad89fa5-1f54-43b9-9c90-5d1a31720d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:54.430478 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad89fa5-1f54-43b9-9c90-5d1a31720d49 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:54.430761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad89fa5-1f54-43b9-9c90-5d1a31720d49 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:54.431034 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad89fa5-1f54-43b9-9c90-5d1a31720d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:54.442408 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad89fa5-1f54-43b9-9c90-5d1a31720d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:54.443964 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad89fa5-1f54-43b9-9c90-5d1a31720d49 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:54.447940 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cff374-d62f-49ad-b1bd-ce9cbb911c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:54.448533 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff374-d62f-49ad-b1bd-ce9cbb911c3f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:54.448811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff374-d62f-49ad-b1bd-ce9cbb911c3f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:54.449081 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff374-d62f-49ad-b1bd-ce9cbb911c3f None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:54.449710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cff374-d62f-49ad-b1bd-ce9cbb911c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:54.450011 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cff374-d62f-49ad-b1bd-ce9cbb911c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:54.451398 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cff374-d62f-49ad-b1bd-ce9cbb911c3f None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-dad89fa5-1f54-43b9-9c90-5d1a31720d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:54.457635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:54.458765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:54.459750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:54.459750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:54.459750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:54.459750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 254/504] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:54.459750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad89fa5-1f54-43b9-9c90-5d1a31720d49 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:54.470956 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 251/505] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:54.470956 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cff374-d62f-49ad-b1bd-ce9cbb911c3f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:54.560691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad89fa5-1f54-43b9-9c90-5d1a31720d49 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:54.565953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cff374-d62f-49ad-b1bd-ce9cbb911c3f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:54.577571 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:54.592104 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:54.595864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94ebe9-dd4d-4137-8102-9df2a8507660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:54.596477 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94ebe9-dd4d-4137-8102-9df2a8507660 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:54.596750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94ebe9-dd4d-4137-8102-9df2a8507660 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:54.597015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94ebe9-dd4d-4137-8102-9df2a8507660 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:54.599736 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bcda5-6f0a-4654-8634-a11dc6528c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:54.600337 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bcda5-6f0a-4654-8634-a11dc6528c02 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:54.600619 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bcda5-6f0a-4654-8634-a11dc6528c02 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:54.600892 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bcda5-6f0a-4654-8634-a11dc6528c02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:54.605376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94ebe9-dd4d-4137-8102-9df2a8507660 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:54.607240 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94ebe9-dd4d-4137-8102-9df2a8507660 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-2e94ebe9-dd4d-4137-8102-9df2a8507660 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:53:54.619993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:54.621079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:54.622262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:54.622262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:54.622262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:53:54.622262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:53:54.622262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:53:54.622262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:53:54.622262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:53:54.622262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:53:54.622262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 14:53:54.622262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:54.622262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 255/506] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:53:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:54.622262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94ebe9-dd4d-4137-8102-9df2a8507660 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:54.674085 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bcda5-6f0a-4654-8634-a11dc6528c02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:54.675550 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bcda5-6f0a-4654-8634-a11dc6528c02 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:54.725450 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94ebe9-dd4d-4137-8102-9df2a8507660 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:54.759722 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32309ca9-127d-417d-b44b-ada87b569caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:54.760320 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32309ca9-127d-417d-b44b-ada87b569caa None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:54.760598 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32309ca9-127d-417d-b44b-ada87b569caa None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:54.760867 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32309ca9-127d-417d-b44b-ada87b569caa None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:54.761498 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32309ca9-127d-417d-b44b-ada87b569caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:54.761797 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32309ca9-127d-417d-b44b-ada87b569caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:54.763213 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32309ca9-127d-417d-b44b-ada87b569caa None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:54.772066 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 252/507] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:54.772909 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bcda5-6f0a-4654-8634-a11dc6528c02 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:54.775499 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 256/508] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:54.776432 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32309ca9-127d-417d-b44b-ada87b569caa None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:54.803852 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:54.820888 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:54.876293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32309ca9-127d-417d-b44b-ada87b569caa None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:54.877254 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bcda5-6f0a-4654-8634-a11dc6528c02 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:54.909483 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0c681-58af-43ff-a8e3-094c3e039095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:54.910110 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0c681-58af-43ff-a8e3-094c3e039095 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:54.910460 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0c681-58af-43ff-a8e3-094c3e039095 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:54.910734 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0c681-58af-43ff-a8e3-094c3e039095 None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:54.911202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44fe2e-4de0-4449-93ed-28628d7cedd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:54.911462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0c681-58af-43ff-a8e3-094c3e039095 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:54.911767 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0c681-58af-43ff-a8e3-094c3e039095 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:54.911853 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44fe2e-4de0-4449-93ed-28628d7cedd9 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:54.912081 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44fe2e-4de0-4449-93ed-28628d7cedd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:54.912346 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44fe2e-4de0-4449-93ed-28628d7cedd9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:54.913249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0c681-58af-43ff-a8e3-094c3e039095 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:54.919893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44fe2e-4de0-4449-93ed-28628d7cedd9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:54.921301 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44fe2e-4de0-4449-93ed-28628d7cedd9 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-cc44fe2e-4de0-4449-93ed-28628d7cedd9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:53:54.933143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:54.934045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:54.935173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:54.935173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:54.935173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:53:54.935173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:53:54.935173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:53:54.935173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:53:54.935173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:53:54.935173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:53:54.935173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 14:53:54.935173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:54.935173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 253/509] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:54.935716 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44fe2e-4de0-4449-93ed-28628d7cedd9 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:54.951235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 257/510] 10.222.0.52 () {56 vars in 1139 bytes} [Wed Aug 31 14:53:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:54.952069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0c681-58af-43ff-a8e3-094c3e039095 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:55.025359 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:55.036348 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44fe2e-4de0-4449-93ed-28628d7cedd9 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:55.047114 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:55.052983 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0c681-58af-43ff-a8e3-094c3e039095 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:55.071430 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63815d-4322-4fe5-bd5c-0125d12200f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:55.071989 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63815d-4322-4fe5-bd5c-0125d12200f0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:55.072270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63815d-4322-4fe5-bd5c-0125d12200f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:55.072582 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63815d-4322-4fe5-bd5c-0125d12200f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:55.082704 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63815d-4322-4fe5-bd5c-0125d12200f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:55.084147 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63815d-4322-4fe5-bd5c-0125d12200f0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:55.088518 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e75de-aba9-4f30-bdff-e8e03e4bceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:55.089138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e75de-aba9-4f30-bdff-e8e03e4bceaf None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:55.089414 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e75de-aba9-4f30-bdff-e8e03e4bceaf None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:55.089682 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e75de-aba9-4f30-bdff-e8e03e4bceaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:55.096243 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e75de-aba9-4f30-bdff-e8e03e4bceaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:55.097671 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e75de-aba9-4f30-bdff-e8e03e4bceaf None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-6e63815d-4322-4fe5-bd5c-0125d12200f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:55.098603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:55.099617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:55.100521 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:55.100521 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:55.100521 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:55.100521 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 254/511] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:55.100875 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63815d-4322-4fe5-bd5c-0125d12200f0 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-208e75de-aba9-4f30-bdff-e8e03e4bceaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:53:55.115775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:55.116812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:55.118269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:53:55.118269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:53:55.118269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:53:55.118269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:53:55.118269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:53:55.118269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:53:55.118269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:53:55.118269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:55.118269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 258/512] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:55.118874 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e75de-aba9-4f30-bdff-e8e03e4bceaf None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:55.206885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63815d-4322-4fe5-bd5c-0125d12200f0 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:55.220326 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e75de-aba9-4f30-bdff-e8e03e4bceaf None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:55.242025 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16363e09-48f2-4f92-8602-cbdd3d2be448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:55.242851 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16363e09-48f2-4f92-8602-cbdd3d2be448 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:55.243133 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16363e09-48f2-4f92-8602-cbdd3d2be448 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:55.243405 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16363e09-48f2-4f92-8602-cbdd3d2be448 None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:55.244126 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16363e09-48f2-4f92-8602-cbdd3d2be448 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:55.244429 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16363e09-48f2-4f92-8602-cbdd3d2be448 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:55.245847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16363e09-48f2-4f92-8602-cbdd3d2be448 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:55.254280 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab2b5-bc1b-4618-8fe0-6cae8cde9eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:55.254606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:55.254915 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab2b5-bc1b-4618-8fe0-6cae8cde9eaa None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:55.255189 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab2b5-bc1b-4618-8fe0-6cae8cde9eaa None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:55.255466 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab2b5-bc1b-4618-8fe0-6cae8cde9eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:55.262658 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 255/513] 10.222.0.52 () {56 vars in 1137 bytes} [Wed Aug 31 14:53:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:55.263457 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16363e09-48f2-4f92-8602-cbdd3d2be448 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:55.284890 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:55.327831 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ab2b5-bc1b-4618-8fe0-6cae8cde9eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:55.329219 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ab2b5-bc1b-4618-8fe0-6cae8cde9eaa None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:55.361052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16363e09-48f2-4f92-8602-cbdd3d2be448 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:55.394219 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f7b24-e649-400f-a647-e6b0bd149c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:55.394842 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f7b24-e649-400f-a647-e6b0bd149c6f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:55.395129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f7b24-e649-400f-a647-e6b0bd149c6f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:55.395401 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f7b24-e649-400f-a647-e6b0bd149c6f None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:55.396046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f7b24-e649-400f-a647-e6b0bd149c6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:55.396351 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f7b24-e649-400f-a647-e6b0bd149c6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:55.397693 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f7b24-e649-400f-a647-e6b0bd149c6f None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:55.409443 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 256/514] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:55.410047 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f7b24-e649-400f-a647-e6b0bd149c6f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:55.430544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 259/515] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:55.431229 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab2b5-bc1b-4618-8fe0-6cae8cde9eaa None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:55.467970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:55.487880 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:55.510116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f7b24-e649-400f-a647-e6b0bd149c6f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:55.530639 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab2b5-bc1b-4618-8fe0-6cae8cde9eaa None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:55.544696 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe0b7c-5acb-44b0-bb2e-af0d3404523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:55.545303 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe0b7c-5acb-44b0-bb2e-af0d3404523a None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:55.545586 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe0b7c-5acb-44b0-bb2e-af0d3404523a None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:55.545860 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe0b7c-5acb-44b0-bb2e-af0d3404523a None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:55.546580 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe0b7c-5acb-44b0-bb2e-af0d3404523a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:55.546889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe0b7c-5acb-44b0-bb2e-af0d3404523a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:55.548309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe0b7c-5acb-44b0-bb2e-af0d3404523a None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:55.565432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 257/516] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:53:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:55.565554 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69922d1-fc8d-4f74-8ac6-ee848f0a68e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:55.566072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69922d1-fc8d-4f74-8ac6-ee848f0a68e9 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:55.566231 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe0b7c-5acb-44b0-bb2e-af0d3404523a None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:55.566382 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69922d1-fc8d-4f74-8ac6-ee848f0a68e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:55.566658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69922d1-fc8d-4f74-8ac6-ee848f0a68e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:55.636322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69922d1-fc8d-4f74-8ac6-ee848f0a68e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:55.637724 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69922d1-fc8d-4f74-8ac6-ee848f0a68e9 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:55.670351 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe0b7c-5acb-44b0-bb2e-af0d3404523a None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:55.686495 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:55.692084 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:55.703067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4e0b4-3ab7-47f9-81f9-0aa12b1f61b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:55.703693 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4e0b4-3ab7-47f9-81f9-0aa12b1f61b1 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:55.703980 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4e0b4-3ab7-47f9-81f9-0aa12b1f61b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:55.704253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4e0b4-3ab7-47f9-81f9-0aa12b1f61b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:55.710760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4e0b4-3ab7-47f9-81f9-0aa12b1f61b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:55.712795 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4e0b4-3ab7-47f9-81f9-0aa12b1f61b1 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-58e4e0b4-3ab7-47f9-81f9-0aa12b1f61b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:53:55.725237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:55.726234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:55.730874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:53:55.730874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:53:55.730874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:53:55.730874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:53:55.730874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:53:55.730874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:53:55.730874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:53:55.730874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:55.731288 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 258/517] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:55.731892 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4e0b4-3ab7-47f9-81f9-0aa12b1f61b1 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:55.737344 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 260/518] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:53:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:53:55.738045 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69922d1-fc8d-4f74-8ac6-ee848f0a68e9 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:55.831258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4e0b4-3ab7-47f9-81f9-0aa12b1f61b1 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:55.841894 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69922d1-fc8d-4f74-8ac6-ee848f0a68e9 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:55.869324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1dbc6-69c8-47e6-aa90-54767cf58aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:55.869955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1dbc6-69c8-47e6-aa90-54767cf58aca None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:55.870238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1dbc6-69c8-47e6-aa90-54767cf58aca None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:55.870558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1dbc6-69c8-47e6-aa90-54767cf58aca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:55.877172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b5d1c-850e-4f16-8721-bf9625f9bb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:55.877767 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b5d1c-850e-4f16-8721-bf9625f9bb98 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:55.878046 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b5d1c-850e-4f16-8721-bf9625f9bb98 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:55.878335 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b5d1c-850e-4f16-8721-bf9625f9bb98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:55.879102 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b5d1c-850e-4f16-8721-bf9625f9bb98 None admin] RBAC: Adding query filter params (role.id=6282183e8c2b48b499413483605de6fc, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=7e0027b550fa4eaaa3f95da115d7da02) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:55.879413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b5d1c-850e-4f16-8721-bf9625f9bb98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:55.880795 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1dbc6-69c8-47e6-aa90-54767cf58aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:55.880889 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b5d1c-850e-4f16-8721-bf9625f9bb98 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:55.882227 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1dbc6-69c8-47e6-aa90-54767cf58aca None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:55.898031 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 261/519] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:55 2022] GET /identity/v3/role_assignments?user.id=7e0027b550fa4eaaa3f95da115d7da02&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=6282183e8c2b48b499413483605de6fc => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:55.898031 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b5d1c-850e-4f16-8721-bf9625f9bb98 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-dad1dbc6-69c8-47e6-aa90-54767cf58aca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:55.898324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:55.899675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:55.900526 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:55.900526 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:55.900526 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:55.900526 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 259/520] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:55.900526 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1dbc6-69c8-47e6-aa90-54767cf58aca None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:55.926856 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:55.937718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:56.020970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b5d1c-850e-4f16-8721-bf9625f9bb98 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:56.021323 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1dbc6-69c8-47e6-aa90-54767cf58aca None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:56.062863 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a39e5-7d8f-46b5-a174-0c065d825e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:56.063266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb1e9b-5a43-4f66-84f6-df1b2bff0f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:56.063505 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a39e5-7d8f-46b5-a174-0c065d825e15 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:56.063743 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a39e5-7d8f-46b5-a174-0c065d825e15 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:56.063899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb1e9b-5a43-4f66-84f6-df1b2bff0f14 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:56.064070 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a39e5-7d8f-46b5-a174-0c065d825e15 None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:56.064218 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb1e9b-5a43-4f66-84f6-df1b2bff0f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:56.064453 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb1e9b-5a43-4f66-84f6-df1b2bff0f14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:56.064699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a39e5-7d8f-46b5-a174-0c065d825e15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:56.065002 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a39e5-7d8f-46b5-a174-0c065d825e15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:56.066534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a39e5-7d8f-46b5-a174-0c065d825e15 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:56.083333 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb1e9b-5a43-4f66-84f6-df1b2bff0f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:56.083333 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb1e9b-5a43-4f66-84f6-df1b2bff0f14 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:56.091226 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 262/521] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:53:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:56.091890 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a39e5-7d8f-46b5-a174-0c065d825e15 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-8ecb1e9b-5a43-4f66-84f6-df1b2bff0f14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:56.103578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:56.104516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:56.105352 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:56.105352 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:56.105352 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:56.105514 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 260/522] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:56.106213 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb1e9b-5a43-4f66-84f6-df1b2bff0f14 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:56.175267 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:56.197154 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a39e5-7d8f-46b5-a174-0c065d825e15 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:56.203905 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:56.223304 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb1e9b-5a43-4f66-84f6-df1b2bff0f14 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:56.233798 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5152e6-5da2-4ca4-859f-9b9dad681309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:56.234557 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5152e6-5da2-4ca4-859f-9b9dad681309 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:56.234813 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5152e6-5da2-4ca4-859f-9b9dad681309 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:56.234984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5152e6-5da2-4ca4-859f-9b9dad681309 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:56.235599 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5152e6-5da2-4ca4-859f-9b9dad681309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:56.235911 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5152e6-5da2-4ca4-859f-9b9dad681309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:56.237294 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5152e6-5da2-4ca4-859f-9b9dad681309 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:56.254932 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 263/523] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:56.255824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5152e6-5da2-4ca4-859f-9b9dad681309 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:56.259919 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014fdaa-0475-490f-a499-1c3e01b20756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:56.260529 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014fdaa-0475-490f-a499-1c3e01b20756 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:56.260810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014fdaa-0475-490f-a499-1c3e01b20756 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:56.261083 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014fdaa-0475-490f-a499-1c3e01b20756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:56.261818 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014fdaa-0475-490f-a499-1c3e01b20756 None admin] RBAC: Adding query filter params (role.id=6282183e8c2b48b499413483605de6fc, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=98bb7c83115a45f1bdf9f48c6599db18) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:56.262126 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014fdaa-0475-490f-a499-1c3e01b20756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:56.263592 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014fdaa-0475-490f-a499-1c3e01b20756 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:56.278322 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 261/524] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:56 2022] GET /identity/v3/role_assignments?user.id=98bb7c83115a45f1bdf9f48c6599db18&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=6282183e8c2b48b499413483605de6fc => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:56.278322 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014fdaa-0475-490f-a499-1c3e01b20756 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:56.402489 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5152e6-5da2-4ca4-859f-9b9dad681309 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:56.403369 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014fdaa-0475-490f-a499-1c3e01b20756 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:56.444030 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b887aa4-5695-4c70-916d-e2fb328d8a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:56.444566 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b887aa4-5695-4c70-916d-e2fb328d8a67 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:56.444847 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b887aa4-5695-4c70-916d-e2fb328d8a67 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:56.445121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b887aa4-5695-4c70-916d-e2fb328d8a67 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:56.445812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b887aa4-5695-4c70-916d-e2fb328d8a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:56.446117 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b887aa4-5695-4c70-916d-e2fb328d8a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:56.447842 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b887aa4-5695-4c70-916d-e2fb328d8a67 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:56.456149 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513172b7-2c1a-40cc-9085-aa50adadd7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:56.456885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513172b7-2c1a-40cc-9085-aa50adadd7c7 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:56.457264 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513172b7-2c1a-40cc-9085-aa50adadd7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:56.457978 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:56.458669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513172b7-2c1a-40cc-9085-aa50adadd7c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:56.463642 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 264/525] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:56.468415 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513172b7-2c1a-40cc-9085-aa50adadd7c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:56.469070 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b887aa4-5695-4c70-916d-e2fb328d8a67 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:56.469950 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513172b7-2c1a-40cc-9085-aa50adadd7c7 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-513172b7-2c1a-40cc-9085-aa50adadd7c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:53:56.482509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:56.483986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:56.485007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:53:56.485007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:53:56.485007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:53:56.485007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:53:56.485007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:53:56.485007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:53:56.485007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:53:56.485007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:56.485007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 262/526] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:56.491193 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513172b7-2c1a-40cc-9085-aa50adadd7c7 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:56.502484 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:56.605890 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513172b7-2c1a-40cc-9085-aa50adadd7c7 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:56.608369 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b887aa4-5695-4c70-916d-e2fb328d8a67 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:56.643890 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64965aeb-27ba-4e9b-94fd-4cb042f8b048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:56.644469 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64965aeb-27ba-4e9b-94fd-4cb042f8b048 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:56.644895 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64965aeb-27ba-4e9b-94fd-4cb042f8b048 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:56.645324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64965aeb-27ba-4e9b-94fd-4cb042f8b048 None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:56.646089 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64965aeb-27ba-4e9b-94fd-4cb042f8b048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:56.646565 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64965aeb-27ba-4e9b-94fd-4cb042f8b048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:56.648095 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64965aeb-27ba-4e9b-94fd-4cb042f8b048 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:56.653740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ae40-b4e2-4792-8072-51dd64fa3d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:56.654578 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ae40-b4e2-4792-8072-51dd64fa3d9f None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:56.655017 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ae40-b4e2-4792-8072-51dd64fa3d9f None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:56.655425 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ae40-b4e2-4792-8072-51dd64fa3d9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:56.662250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 263/527] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:56.670331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2ae40-b4e2-4792-8072-51dd64fa3d9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:56.670482 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64965aeb-27ba-4e9b-94fd-4cb042f8b048 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:56.670570 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2ae40-b4e2-4792-8072-51dd64fa3d9f None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-49a2ae40-b4e2-4792-8072-51dd64fa3d9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:53:56.682202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:56.683156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:56.683996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:53:56.683996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:53:56.683996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:53:56.683996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:53:56.683996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:53:56.683996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:53:56.683996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:53:56.683996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:56.688403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 265/528] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:56.689234 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ae40-b4e2-4792-8072-51dd64fa3d9f None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:56.737552 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:56.756936 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:56.777309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64965aeb-27ba-4e9b-94fd-4cb042f8b048 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:56.806461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ae40-b4e2-4792-8072-51dd64fa3d9f None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:56.814932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afd67d-9828-4268-9ac8-dfc220ffb869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:56.815340 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afd67d-9828-4268-9ac8-dfc220ffb869 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:56.815615 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afd67d-9828-4268-9ac8-dfc220ffb869 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:56.816145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afd67d-9828-4268-9ac8-dfc220ffb869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:56.816876 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afd67d-9828-4268-9ac8-dfc220ffb869 None admin] RBAC: Adding query filter params (role.id=6282183e8c2b48b499413483605de6fc, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=5c3e43e391e1470e90b21511b98b0d40) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:56.817239 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afd67d-9828-4268-9ac8-dfc220ffb869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:56.818787 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afd67d-9828-4268-9ac8-dfc220ffb869 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:56.830791 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 264/529] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:56 2022] GET /identity/v3/role_assignments?user.id=5c3e43e391e1470e90b21511b98b0d40&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=6282183e8c2b48b499413483605de6fc => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:56.855295 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4a9ba-6ceb-497a-9920-a82f5e087219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:56.855937 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4a9ba-6ceb-497a-9920-a82f5e087219 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:56.856220 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4a9ba-6ceb-497a-9920-a82f5e087219 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:56.856506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4a9ba-6ceb-497a-9920-a82f5e087219 None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:56.857205 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4a9ba-6ceb-497a-9920-a82f5e087219 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:56.857510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4a9ba-6ceb-497a-9920-a82f5e087219 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:56.862372 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4a9ba-6ceb-497a-9920-a82f5e087219 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:56.873772 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 266/530] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:56.879847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afd67d-9828-4268-9ac8-dfc220ffb869 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:56.995937 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afd67d-9828-4268-9ac8-dfc220ffb869 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:57.031091 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:57.038227 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f49c97-f4cd-4fa0-8de3-2141b5d7d042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:57.040104 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49c97-f4cd-4fa0-8de3-2141b5d7d042 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:57.040597 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49c97-f4cd-4fa0-8de3-2141b5d7d042 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:57.041034 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49c97-f4cd-4fa0-8de3-2141b5d7d042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:57.041956 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49c97-f4cd-4fa0-8de3-2141b5d7d042 None admin] RBAC: Adding query filter params (role.id=6282183e8c2b48b499413483605de6fc, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=1308dea6ef324bf388a0339ca911f36c) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:57.042465 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49c97-f4cd-4fa0-8de3-2141b5d7d042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:57.050025 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49c97-f4cd-4fa0-8de3-2141b5d7d042 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:57.051998 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 265/531] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:53:56 2022] GET /identity/v3/role_assignments?user.id=1308dea6ef324bf388a0339ca911f36c&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=6282183e8c2b48b499413483605de6fc => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:58.125826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce4100-b01a-4b25-afcd-e8dcdda99c90 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:58.126341 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce4100-b01a-4b25-afcd-e8dcdda99c90 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:58.126341 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce4100-b01a-4b25-afcd-e8dcdda99c90 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:58.128061 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 267/532] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:58.133931 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7c5d1-9f9f-4150-a361-7147bd696af0 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:58.134389 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7c5d1-9f9f-4150-a361-7147bd696af0 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:58.134608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7c5d1-9f9f-4150-a361-7147bd696af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:58.153830 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-9df7c5d1-9f9f-4150-a361-7147bd696af0 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:58.155101 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-9df7c5d1-9f9f-4150-a361-7147bd696af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:58.228868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 266/533] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:58.493942 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c7719-e82f-4ea0-bbfd-56f8b595b86d None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:58.494323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c7719-e82f-4ea0-bbfd-56f8b595b86d None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:58.494520 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c7719-e82f-4ea0-bbfd-56f8b595b86d None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:58.496168 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 268/534] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:58.501311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3a47-87d3-4538-8c40-d8c937c393d1 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:58.501601 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3a47-87d3-4538-8c40-d8c937c393d1 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:58.501878 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3a47-87d3-4538-8c40-d8c937c393d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:58.524952 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-ab7a3a47-87d3-4538-8c40-d8c937c393d1 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:58.526199 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-ab7a3a47-87d3-4538-8c40-d8c937c393d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:58.557010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c7719-e82f-4ea0-bbfd-56f8b595b86d None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:58.598012 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 267/535] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:58.668356 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c7719-e82f-4ea0-bbfd-56f8b595b86d None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:58.690154 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:58.705355 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6ba54-4b42-4a57-b94c-e4c4bc2696c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:58.707198 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6ba54-4b42-4a57-b94c-e4c4bc2696c0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:58.707198 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6ba54-4b42-4a57-b94c-e4c4bc2696c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:58.707198 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6ba54-4b42-4a57-b94c-e4c4bc2696c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:58.718528 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6ba54-4b42-4a57-b94c-e4c4bc2696c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-3fa6ba54-4b42-4a57-b94c-e4c4bc2696c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:58.723780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:58.724924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:58.725918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:58.725918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:58.725918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:58.725918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:58.725918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:58.725918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:58.725918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:58.725918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:58.725918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:58.725918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:58.725918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:53:58.725918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:58.728786 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 269/536] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:53:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:58.734626 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a3a47-87d3-4538-8c40-d8c937c393d1 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:58.798371 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:58.860133 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a3a47-87d3-4538-8c40-d8c937c393d1 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:58.897065 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e65df-8b10-422a-a53a-677a4f7e5e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:58.897682 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e65df-8b10-422a-a53a-677a4f7e5e7f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:58.897965 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e65df-8b10-422a-a53a-677a4f7e5e7f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:58.898235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e65df-8b10-422a-a53a-677a4f7e5e7f None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:58.899726 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e65df-8b10-422a-a53a-677a4f7e5e7f None admin] RBAC: Adding query filter params (name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:58.900031 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e65df-8b10-422a-a53a-677a4f7e5e7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:58.901408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e65df-8b10-422a-a53a-677a4f7e5e7f None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:58.910219 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 268/537] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:53:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:58.916235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6ba54-4b42-4a57-b94c-e4c4bc2696c0 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:58.932383 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e65df-8b10-422a-a53a-677a4f7e5e7f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:59.032482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6ba54-4b42-4a57-b94c-e4c4bc2696c0 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:59.044305 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e65df-8b10-422a-a53a-677a4f7e5e7f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:59.063109 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:59.075749 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e29da-4bd5-4a3a-829f-cb78aeece5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:59.075749 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e29da-4bd5-4a3a-829f-cb78aeece5e5 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.075749 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e29da-4bd5-4a3a-829f-cb78aeece5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.076315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e29da-4bd5-4a3a-829f-cb78aeece5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.082148 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb00fe5-a123-468c-b5c3-47ccc7cfca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:59.082816 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb00fe5-a123-468c-b5c3-47ccc7cfca81 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.083096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb00fe5-a123-468c-b5c3-47ccc7cfca81 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.083370 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb00fe5-a123-468c-b5c3-47ccc7cfca81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.088995 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e29da-4bd5-4a3a-829f-cb78aeece5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:59.090816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e29da-4bd5-4a3a-829f-cb78aeece5e5 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:59.094899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb00fe5-a123-468c-b5c3-47ccc7cfca81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-ebb00fe5-a123-468c-b5c3-47ccc7cfca81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:53:59.099717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:59.100590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:59.101384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 269/538] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:53:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:53:59.111285 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb00fe5-a123-468c-b5c3-47ccc7cfca81 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-502e29da-4bd5-4a3a-829f-cb78aeece5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:59.112455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:59.113338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:59.114256 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:59.114256 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:59.114256 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:59.118852 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 270/539] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:59.119723 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e29da-4bd5-4a3a-829f-cb78aeece5e5 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:59.154405 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:59.239952 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb00fe5-a123-468c-b5c3-47ccc7cfca81 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:59.240522 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e29da-4bd5-4a3a-829f-cb78aeece5e5 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:59.276347 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8f307-d5c7-4335-a9f9-386f8555a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:59.276955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8f307-d5c7-4335-a9f9-386f8555a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.277227 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8f307-d5c7-4335-a9f9-386f8555a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.277500 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8f307-d5c7-4335-a9f9-386f8555a3e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.277849 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbfc73-db59-451e-b392-e6add42edf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:59.278167 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8f307-d5c7-4335-a9f9-386f8555a3e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:59.278482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbfc73-db59-451e-b392-e6add42edf39 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.278577 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8f307-d5c7-4335-a9f9-386f8555a3e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:59.278764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbfc73-db59-451e-b392-e6add42edf39 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.279033 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbfc73-db59-451e-b392-e6add42edf39 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.279670 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbfc73-db59-451e-b392-e6add42edf39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:59.279844 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8f307-d5c7-4335-a9f9-386f8555a3e4 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:59.280031 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbfc73-db59-451e-b392-e6add42edf39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:59.281494 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbfc73-db59-451e-b392-e6add42edf39 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:59.293099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 270/540] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:53:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:59.293099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccad48-b968-40b1-b782-69e3138b4a34 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.293099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccad48-b968-40b1-b782-69e3138b4a34 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.293099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccad48-b968-40b1-b782-69e3138b4a34 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.293099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 271/541] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:59.295312 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccad48-b968-40b1-b782-69e3138b4a34 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:59.299479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 271/542] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:59.300926 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e9004-e67b-4cb0-b4dd-42362e18c1ea None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.301219 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e9004-e67b-4cb0-b4dd-42362e18c1ea None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.301493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e9004-e67b-4cb0-b4dd-42362e18c1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.321498 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-c39e9004-e67b-4cb0-b4dd-42362e18c1ea None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:59.322768 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-c39e9004-e67b-4cb0-b4dd-42362e18c1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:59.339496 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:59.393184 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 272/543] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:59.394031 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e9004-e67b-4cb0-b4dd-42362e18c1ea None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:59.400983 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccad48-b968-40b1-b782-69e3138b4a34 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:59.424581 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:59.438744 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9dc96-7d0e-4fad-8827-4da430ac9360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:59.439376 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9dc96-7d0e-4fad-8827-4da430ac9360 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.439659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9dc96-7d0e-4fad-8827-4da430ac9360 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.439933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9dc96-7d0e-4fad-8827-4da430ac9360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.450825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9dc96-7d0e-4fad-8827-4da430ac9360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:59.452264 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9dc96-7d0e-4fad-8827-4da430ac9360 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-92d9dc96-7d0e-4fad-8827-4da430ac9360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:53:59.466451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:59.467364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:53:59.468228 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:53:59.468228 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:53:59.468228 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:53:59.468228 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 272/544] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:59.468904 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9c0a9-01c5-4be7-9678-e34bebb08846 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.469105 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9c0a9-01c5-4be7-9678-e34bebb08846 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.469384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9c0a9-01c5-4be7-9678-e34bebb08846 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.471899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 273/545] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:53:59.472787 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9c0a9-01c5-4be7-9678-e34bebb08846 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:59.510944 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e9004-e67b-4cb0-b4dd-42362e18c1ea None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:59.548558 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366d483-9c84-471d-a485-a8621f53733c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:59.549175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366d483-9c84-471d-a485-a8621f53733c None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.549450 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366d483-9c84-471d-a485-a8621f53733c None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.549715 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366d483-9c84-471d-a485-a8621f53733c None admin] PATH_INFO: `/v3/users/glance` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.558164 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366d483-9c84-471d-a485-a8621f53733c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:59.559635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366d483-9c84-471d-a485-a8621f53733c None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-1366d483-9c84-471d-a485-a8621f53733c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:53:59.571850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:59.572748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:59.573637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:59.573637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:59.573637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:53:59.573637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:53:59.573637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:53:59.573637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:53:59.573637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:53:59.573637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:53:59.573637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 14:53:59.573637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:59.573637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 273/546] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:53:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:59.574205 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb605f-eea1-45f3-bace-62e0e59cbf6b None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.574270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb605f-eea1-45f3-bace-62e0e59cbf6b None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.574865 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb605f-eea1-45f3-bace-62e0e59cbf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.575464 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:59.589089 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9c0a9-01c5-4be7-9678-e34bebb08846 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:59.593025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-c7fb605f-eea1-45f3-bace-62e0e59cbf6b None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:53:59.594235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-c7fb605f-eea1-45f3-bace-62e0e59cbf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:53:59.627899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0de6-208d-43a2-8423-6f9079875c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:59.628514 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0de6-208d-43a2-8423-6f9079875c57 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.628799 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0de6-208d-43a2-8423-6f9079875c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.629078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0de6-208d-43a2-8423-6f9079875c57 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.629720 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f0de6-208d-43a2-8423-6f9079875c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:59.630023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f0de6-208d-43a2-8423-6f9079875c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:59.631434 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f0de6-208d-43a2-8423-6f9079875c57 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:59.643464 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 274/547] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:59.644176 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0de6-208d-43a2-8423-6f9079875c57 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:59.686502 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 274/548] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:53:59.686502 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb605f-eea1-45f3-bace-62e0e59cbf6b None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:59.710068 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:59.770239 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0de6-208d-43a2-8423-6f9079875c57 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:59.807487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cccec7-0dd3-4971-87ec-ae15de314ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:59.808445 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cccec7-0dd3-4971-87ec-ae15de314ef2 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.808873 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cccec7-0dd3-4971-87ec-ae15de314ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.809342 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cccec7-0dd3-4971-87ec-ae15de314ef2 None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.810663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cccec7-0dd3-4971-87ec-ae15de314ef2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:53:59.811463 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cccec7-0dd3-4971-87ec-ae15de314ef2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:59.813153 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cccec7-0dd3-4971-87ec-ae15de314ef2 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:59.814700 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb605f-eea1-45f3-bace-62e0e59cbf6b None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:59.842547 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 275/549] 10.222.0.52 () {56 vars in 1137 bytes} [Wed Aug 31 14:53:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:53:59.843761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cccec7-0dd3-4971-87ec-ae15de314ef2 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:59.859160 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:53:59.863641 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e134-d07a-45a6-879f-fc806bf64baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:53:59.864318 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e134-d07a-45a6-879f-fc806bf64baf None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:53:59.864593 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e134-d07a-45a6-879f-fc806bf64baf None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:53:59.864859 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e134-d07a-45a6-879f-fc806bf64baf None admin] PATH_INFO: `/v3/users/nova` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:53:59.873827 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22e134-d07a-45a6-879f-fc806bf64baf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:53:59.875996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22e134-d07a-45a6-879f-fc806bf64baf None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-eb22e134-d07a-45a6-879f-fc806bf64baf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:53:59.891835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:53:59.893253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:53:59.894163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:53:59.894163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:53:59.894163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:53:59.894163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:53:59.894163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:53:59.894163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:53:59.894163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:53:59.894163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:53:59.894163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 14:53:59.894163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:53:59.894163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 275/550] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 31 14:53:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:53:59.894163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e134-d07a-45a6-879f-fc806bf64baf None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:53:59.975080 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cccec7-0dd3-4971-87ec-ae15de314ef2 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:53:59.986163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:00.017637 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9f521-9abc-4551-9774-f4fd626f2033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:00.018501 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f521-9abc-4551-9774-f4fd626f2033 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:00.018613 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f521-9abc-4551-9774-f4fd626f2033 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:00.018896 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f521-9abc-4551-9774-f4fd626f2033 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:00.026268 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e134-d07a-45a6-879f-fc806bf64baf None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:00.030377 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9f521-9abc-4551-9774-f4fd626f2033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-4cf9f521-9abc-4551-9774-f4fd626f2033 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:54:00.035276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:00.036810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 276/551] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:53:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:00.038544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9f521-9abc-4551-9774-f4fd626f2033 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:00.072274 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb4536-40ba-4dda-906a-721d748ba64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:00.073242 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb4536-40ba-4dda-906a-721d748ba64c None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:00.073685 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb4536-40ba-4dda-906a-721d748ba64c None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:00.074126 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb4536-40ba-4dda-906a-721d748ba64c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:00.087153 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb4536-40ba-4dda-906a-721d748ba64c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:00.089197 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb4536-40ba-4dda-906a-721d748ba64c None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-59cb4536-40ba-4dda-906a-721d748ba64c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:00.106109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:00.107516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:00.109007 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:00.109007 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:00.109007 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:00.109007 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 276/552] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:00.109007 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb4536-40ba-4dda-906a-721d748ba64c None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:00.115802 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:00.151349 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9f521-9abc-4551-9774-f4fd626f2033 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:00.188571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a62a9-9e49-4980-bfc2-defe8ba7837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:00.189177 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a62a9-9e49-4980-bfc2-defe8ba7837c None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:00.189457 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a62a9-9e49-4980-bfc2-defe8ba7837c None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:00.189725 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a62a9-9e49-4980-bfc2-defe8ba7837c None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:00.190488 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a62a9-9e49-4980-bfc2-defe8ba7837c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:00.190792 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a62a9-9e49-4980-bfc2-defe8ba7837c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:00.192362 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a62a9-9e49-4980-bfc2-defe8ba7837c None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:00.214613 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 277/553] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 31 14:54:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:00.215476 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a62a9-9e49-4980-bfc2-defe8ba7837c None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:00.227265 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb4536-40ba-4dda-906a-721d748ba64c None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:00.255873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:00.266993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f982b1b-2185-4050-b83a-354d2faad4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:00.270619 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f982b1b-2185-4050-b83a-354d2faad4a1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:00.270619 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f982b1b-2185-4050-b83a-354d2faad4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:00.270619 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f982b1b-2185-4050-b83a-354d2faad4a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:00.281111 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f982b1b-2185-4050-b83a-354d2faad4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-6f982b1b-2185-4050-b83a-354d2faad4a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:54:00.287929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:00.289085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:00.290077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 277/554] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:54:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:00.291050 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f982b1b-2185-4050-b83a-354d2faad4a1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:00.328640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a62a9-9e49-4980-bfc2-defe8ba7837c None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:00.356484 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:00.365169 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d76567-984b-4135-bfe7-b5a5cf99dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:00.367963 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d76567-984b-4135-bfe7-b5a5cf99dd8d None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:00.367963 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d76567-984b-4135-bfe7-b5a5cf99dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:00.367963 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d76567-984b-4135-bfe7-b5a5cf99dd8d None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:00.367963 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d76567-984b-4135-bfe7-b5a5cf99dd8d None admin] RBAC: Adding query filter params (name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:00.367963 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d76567-984b-4135-bfe7-b5a5cf99dd8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:00.368879 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d76567-984b-4135-bfe7-b5a5cf99dd8d None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:00.382674 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 278/555] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:54:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:00.384639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d76567-984b-4135-bfe7-b5a5cf99dd8d None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:00.405291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f982b1b-2185-4050-b83a-354d2faad4a1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:00.443629 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892b092-4cd7-4f34-a8d5-3631599fb3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:00.444370 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892b092-4cd7-4f34-a8d5-3631599fb3bd None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:00.444707 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892b092-4cd7-4f34-a8d5-3631599fb3bd None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:00.445131 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892b092-4cd7-4f34-a8d5-3631599fb3bd None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:00.446697 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892b092-4cd7-4f34-a8d5-3631599fb3bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:00.446697 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892b092-4cd7-4f34-a8d5-3631599fb3bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:00.449431 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892b092-4cd7-4f34-a8d5-3631599fb3bd None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:00.462405 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 278/556] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:00.463245 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892b092-4cd7-4f34-a8d5-3631599fb3bd None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:00.493298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d76567-984b-4135-bfe7-b5a5cf99dd8d None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:00.520164 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:00.528311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9968-e3ac-460a-be5b-3f346b564b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:00.528947 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9968-e3ac-460a-be5b-3f346b564b10 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:00.529228 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9968-e3ac-460a-be5b-3f346b564b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:00.529498 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9968-e3ac-460a-be5b-3f346b564b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:00.540585 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b9968-e3ac-460a-be5b-3f346b564b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:00.542032 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b9968-e3ac-460a-be5b-3f346b564b10 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-574b9968-e3ac-460a-be5b-3f346b564b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:00.557628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:00.558748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:00.559646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:00.559646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:00.559646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:00.559646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 279/557] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:00.559919 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9968-e3ac-460a-be5b-3f346b564b10 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:00.582652 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892b092-4cd7-4f34-a8d5-3631599fb3bd None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:00.602444 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:00.617677 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ede14-5b13-48f0-a168-50ab6aa30de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:00.618228 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ede14-5b13-48f0-a168-50ab6aa30de6 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:00.618535 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ede14-5b13-48f0-a168-50ab6aa30de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:00.618806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ede14-5b13-48f0-a168-50ab6aa30de6 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:00.619494 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ede14-5b13-48f0-a168-50ab6aa30de6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:00.619914 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ede14-5b13-48f0-a168-50ab6aa30de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:00.621403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ede14-5b13-48f0-a168-50ab6aa30de6 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:00.629191 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 279/558] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:54:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:00.629975 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ede14-5b13-48f0-a168-50ab6aa30de6 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:00.664555 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9968-e3ac-460a-be5b-3f346b564b10 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:00.697790 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7a828-5c1a-4f39-a72b-0e6ecf41fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:00.698443 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7a828-5c1a-4f39-a72b-0e6ecf41fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:00.698726 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7a828-5c1a-4f39-a72b-0e6ecf41fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:00.698989 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7a828-5c1a-4f39-a72b-0e6ecf41fbf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:00.709547 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7a828-5c1a-4f39-a72b-0e6ecf41fbf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:00.711123 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7a828-5c1a-4f39-a72b-0e6ecf41fbf2 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-5ad7a828-5c1a-4f39-a72b-0e6ecf41fbf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:00.725046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:00.731129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:00.732430 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:00.732430 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:00.732430 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:00.732430 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 280/559] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:00.732430 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7a828-5c1a-4f39-a72b-0e6ecf41fbf2 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:00.732711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ede14-5b13-48f0-a168-50ab6aa30de6 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:00.737276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:00.768137 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec24e2-128a-4055-9098-49bd2a7014c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:00.768763 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec24e2-128a-4055-9098-49bd2a7014c0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:00.769042 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec24e2-128a-4055-9098-49bd2a7014c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:00.769313 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec24e2-128a-4055-9098-49bd2a7014c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:00.776174 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec24e2-128a-4055-9098-49bd2a7014c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:00.777626 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec24e2-128a-4055-9098-49bd2a7014c0 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-04ec24e2-128a-4055-9098-49bd2a7014c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:54:00.788653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:00.790331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:00.791762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:54:00.791762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:54:00.791762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:54:00.791762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:54:00.791762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:54:00.791762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:54:00.791762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:00.791762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:00.791762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 280/560] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:00.791762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec24e2-128a-4055-9098-49bd2a7014c0 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:00.822722 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:00.831286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7a828-5c1a-4f39-a72b-0e6ecf41fbf2 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:00.868055 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c0479-e7bb-4b0b-afc5-6886e39f67c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:00.868597 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c0479-e7bb-4b0b-afc5-6886e39f67c5 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:00.868877 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c0479-e7bb-4b0b-afc5-6886e39f67c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:00.869326 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c0479-e7bb-4b0b-afc5-6886e39f67c5 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:00.869972 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c0479-e7bb-4b0b-afc5-6886e39f67c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:00.870284 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c0479-e7bb-4b0b-afc5-6886e39f67c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:00.871660 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c0479-e7bb-4b0b-afc5-6886e39f67c5 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:00.882816 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 281/561] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:00.883631 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c0479-e7bb-4b0b-afc5-6886e39f67c5 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:00.900286 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec24e2-128a-4055-9098-49bd2a7014c0 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:00.935873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba5634-eca7-423c-87ed-f1b94d306c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:00.936496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba5634-eca7-423c-87ed-f1b94d306c91 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:00.936778 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba5634-eca7-423c-87ed-f1b94d306c91 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:00.937045 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba5634-eca7-423c-87ed-f1b94d306c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:00.947230 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba5634-eca7-423c-87ed-f1b94d306c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:00.948662 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba5634-eca7-423c-87ed-f1b94d306c91 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-b1ba5634-eca7-423c-87ed-f1b94d306c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:00.962931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:00.964029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:00.964909 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:00.964909 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:00.964909 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:00.964909 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 281/562] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:00.964909 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba5634-eca7-423c-87ed-f1b94d306c91 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:00.984730 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:00.994091 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c0479-e7bb-4b0b-afc5-6886e39f67c5 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:01.019151 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d3051-38f0-4146-ad52-435427c83e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:01.020250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d3051-38f0-4146-ad52-435427c83e6e None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:01.020250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d3051-38f0-4146-ad52-435427c83e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:01.020434 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d3051-38f0-4146-ad52-435427c83e6e None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:01.021056 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d3051-38f0-4146-ad52-435427c83e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:01.021362 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d3051-38f0-4146-ad52-435427c83e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:01.022823 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d3051-38f0-4146-ad52-435427c83e6e None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:01.035851 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 282/563] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:01.039495 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d3051-38f0-4146-ad52-435427c83e6e None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:01.050787 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:01.065700 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba5634-eca7-423c-87ed-f1b94d306c91 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:01.100961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a7294-e3d2-406f-9442-008e8f398764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:01.101629 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7294-e3d2-406f-9442-008e8f398764 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:01.102171 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7294-e3d2-406f-9442-008e8f398764 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:01.102171 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7294-e3d2-406f-9442-008e8f398764 None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:01.102881 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a7294-e3d2-406f-9442-008e8f398764 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:01.103188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a7294-e3d2-406f-9442-008e8f398764 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:01.104627 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a7294-e3d2-406f-9442-008e8f398764 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:01.116219 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 282/564] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:01.117003 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a7294-e3d2-406f-9442-008e8f398764 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:01.137511 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d3051-38f0-4146-ad52-435427c83e6e None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:01.171605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768fa0b-14dd-4d11-b0a9-c119da79b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:01.172225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768fa0b-14dd-4d11-b0a9-c119da79b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:01.172500 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768fa0b-14dd-4d11-b0a9-c119da79b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:01.172768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768fa0b-14dd-4d11-b0a9-c119da79b0e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:01.179244 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768fa0b-14dd-4d11-b0a9-c119da79b0e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:01.181312 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768fa0b-14dd-4d11-b0a9-c119da79b0e8 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-b768fa0b-14dd-4d11-b0a9-c119da79b0e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:54:01.192215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:01.193110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:01.193995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:54:01.193995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:54:01.193995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:54:01.193995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:54:01.193995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:54:01.193995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:54:01.193995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:01.193995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:01.193995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 283/565] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:01.194526 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768fa0b-14dd-4d11-b0a9-c119da79b0e8 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:01.199432 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:01.221047 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a7294-e3d2-406f-9442-008e8f398764 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:01.255358 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8057d5-8f39-466b-961b-d21ae5a884f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:01.256058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8057d5-8f39-466b-961b-d21ae5a884f8 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:01.256337 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8057d5-8f39-466b-961b-d21ae5a884f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:01.256609 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8057d5-8f39-466b-961b-d21ae5a884f8 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:01.257243 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8057d5-8f39-466b-961b-d21ae5a884f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:01.257545 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8057d5-8f39-466b-961b-d21ae5a884f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:01.259511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8057d5-8f39-466b-961b-d21ae5a884f8 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:01.264459 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:01.271468 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 283/566] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:01.272267 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8057d5-8f39-466b-961b-d21ae5a884f8 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:01.296950 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768fa0b-14dd-4d11-b0a9-c119da79b0e8 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:01.333449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4299c-376d-4d66-9a3e-ba24fc7b1cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:01.334071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4299c-376d-4d66-9a3e-ba24fc7b1cd5 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:01.334371 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4299c-376d-4d66-9a3e-ba24fc7b1cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:01.334646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4299c-376d-4d66-9a3e-ba24fc7b1cd5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:01.342427 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4299c-376d-4d66-9a3e-ba24fc7b1cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:01.343853 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4299c-376d-4d66-9a3e-ba24fc7b1cd5 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-17f4299c-376d-4d66-9a3e-ba24fc7b1cd5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:54:01.356071 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:01.357072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:01.358286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:01.358286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:01.358286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:54:01.358286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:54:01.358286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:54:01.358286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:54:01.358286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:54:01.358286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:54:01.358286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 14:54:01.358286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:01.362047 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 284/567] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:54:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:01.362903 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4299c-376d-4d66-9a3e-ba24fc7b1cd5 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:01.373741 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8057d5-8f39-466b-961b-d21ae5a884f8 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:01.409658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8a48-262f-41a8-8d37-0d1152d82d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:01.410338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8a48-262f-41a8-8d37-0d1152d82d8c None admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:01.410619 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8a48-262f-41a8-8d37-0d1152d82d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:01.412560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8a48-262f-41a8-8d37-0d1152d82d8c None admin] PATH_INFO: `/v3/projects/cac45966110b47f28339c78e693b3793/users/7e0027b550fa4eaaa3f95da115d7da02/roles/6282183e8c2b48b499413483605de6fc` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:01.419622 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:01.426986 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8a48-262f-41a8-8d37-0d1152d82d8c None admin] RBAC: Authorizing `identity:create_grant(project_id=cac45966110b47f28339c78e693b3793, user_id=7e0027b550fa4eaaa3f95da115d7da02, role_id=6282183e8c2b48b499413483605de6fc)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:01.429634 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8a48-262f-41a8-8d37-0d1152d82d8c None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:01.463412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4299c-376d-4d66-9a3e-ba24fc7b1cd5 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:01.479926 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 284/568] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:54:01 2022] PUT /identity/v3/projects/cac45966110b47f28339c78e693b3793/users/7e0027b550fa4eaaa3f95da115d7da02/roles/6282183e8c2b48b499413483605de6fc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:54:01.480731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8a48-262f-41a8-8d37-0d1152d82d8c None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:01.500742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:01.506913 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b848c5-72cf-4d25-9164-7e80cc8738aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:01.507539 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b848c5-72cf-4d25-9164-7e80cc8738aa None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:01.507869 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b848c5-72cf-4d25-9164-7e80cc8738aa None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:01.508262 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b848c5-72cf-4d25-9164-7e80cc8738aa None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:01.508992 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b848c5-72cf-4d25-9164-7e80cc8738aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:01.509283 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b848c5-72cf-4d25-9164-7e80cc8738aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:01.510941 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b848c5-72cf-4d25-9164-7e80cc8738aa None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:01.526836 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 285/569] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:54:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:01.532712 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b848c5-72cf-4d25-9164-7e80cc8738aa None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:01.599913 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8a48-262f-41a8-8d37-0d1152d82d8c None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:01.641534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b669d-eebb-4887-9496-9d8b71f624ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:01.642533 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b669d-eebb-4887-9496-9d8b71f624ed None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:01.643026 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b669d-eebb-4887-9496-9d8b71f624ed None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:01.643481 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b669d-eebb-4887-9496-9d8b71f624ed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:01.652163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b848c5-72cf-4d25-9164-7e80cc8738aa None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:01.652784 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b669d-eebb-4887-9496-9d8b71f624ed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:01.654525 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b669d-eebb-4887-9496-9d8b71f624ed None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-d70b669d-eebb-4887-9496-9d8b71f624ed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:54:01.670155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:01.671151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:01.672109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:01.672109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:01.672109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:54:01.672109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:54:01.672109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:54:01.672109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:54:01.672109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:54:01.672109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:54:01.672109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 14:54:01.672109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:01.672109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 285/570] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:54:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:01.672109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b669d-eebb-4887-9496-9d8b71f624ed None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:01.696540 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41f35b-2877-499b-84da-2b03e7c2ff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:01.697244 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41f35b-2877-499b-84da-2b03e7c2ff40 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:01.697592 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41f35b-2877-499b-84da-2b03e7c2ff40 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:01.697935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41f35b-2877-499b-84da-2b03e7c2ff40 None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:01.698769 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41f35b-2877-499b-84da-2b03e7c2ff40 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:01.699141 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41f35b-2877-499b-84da-2b03e7c2ff40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:01.700628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41f35b-2877-499b-84da-2b03e7c2ff40 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:01.719152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 286/571] 10.222.0.52 () {56 vars in 1139 bytes} [Wed Aug 31 14:54:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:01.719998 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41f35b-2877-499b-84da-2b03e7c2ff40 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:01.727858 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:01.777763 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:01.787572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b669d-eebb-4887-9496-9d8b71f624ed None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:01.827292 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da5b93-c937-4a6c-9d37-208a15322104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:01.827951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da5b93-c937-4a6c-9d37-208a15322104 None admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:01.828230 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da5b93-c937-4a6c-9d37-208a15322104 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:01.828503 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da5b93-c937-4a6c-9d37-208a15322104 None admin] PATH_INFO: `/v3/projects/cac45966110b47f28339c78e693b3793/users/98bb7c83115a45f1bdf9f48c6599db18/roles/6282183e8c2b48b499413483605de6fc` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:01.834502 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41f35b-2877-499b-84da-2b03e7c2ff40 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:01.845163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da5b93-c937-4a6c-9d37-208a15322104 None admin] RBAC: Authorizing `identity:create_grant(project_id=cac45966110b47f28339c78e693b3793, user_id=98bb7c83115a45f1bdf9f48c6599db18, role_id=6282183e8c2b48b499413483605de6fc)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:01.847072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da5b93-c937-4a6c-9d37-208a15322104 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:01.875014 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3cf08-35da-4717-b680-d7c6553e31c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:01.875622 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3cf08-35da-4717-b680-d7c6553e31c9 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:01.875901 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3cf08-35da-4717-b680-d7c6553e31c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:01.876174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3cf08-35da-4717-b680-d7c6553e31c9 None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:01.876897 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3cf08-35da-4717-b680-d7c6553e31c9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:01.877200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3cf08-35da-4717-b680-d7c6553e31c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:01.878654 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3cf08-35da-4717-b680-d7c6553e31c9 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:01.896177 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 287/572] 10.222.0.52 () {56 vars in 1137 bytes} [Wed Aug 31 14:54:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:01.896979 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3cf08-35da-4717-b680-d7c6553e31c9 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:01.924813 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 286/573] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:54:01 2022] PUT /identity/v3/projects/cac45966110b47f28339c78e693b3793/users/98bb7c83115a45f1bdf9f48c6599db18/roles/6282183e8c2b48b499413483605de6fc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:54:01.925939 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da5b93-c937-4a6c-9d37-208a15322104 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:02.025173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3cf08-35da-4717-b680-d7c6553e31c9 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:02.039525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:02.078733 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6162d-61ee-48a3-af77-009d70cce94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:02.080279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6162d-61ee-48a3-af77-009d70cce94a None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:02.080847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6162d-61ee-48a3-af77-009d70cce94a None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:02.082486 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6162d-61ee-48a3-af77-009d70cce94a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:02.082878 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:02.089197 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da5b93-c937-4a6c-9d37-208a15322104 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:02.098055 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6162d-61ee-48a3-af77-009d70cce94a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:02.100368 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6162d-61ee-48a3-af77-009d70cce94a None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-39b6162d-61ee-48a3-af77-009d70cce94a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:02.123517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:02.124718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:02.125814 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:02.125814 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:02.125814 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:02.128224 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 288/574] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:02.136840 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6162d-61ee-48a3-af77-009d70cce94a None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:02.139811 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60251d-2e56-4e67-90c9-3030b1a267ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:02.140669 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60251d-2e56-4e67-90c9-3030b1a267ba None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:02.140953 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60251d-2e56-4e67-90c9-3030b1a267ba None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:02.141227 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60251d-2e56-4e67-90c9-3030b1a267ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:02.159938 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60251d-2e56-4e67-90c9-3030b1a267ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:02.161849 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60251d-2e56-4e67-90c9-3030b1a267ba None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-ca60251d-2e56-4e67-90c9-3030b1a267ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:02.182376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:02.183713 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:02.184801 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:02.184801 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:02.184801 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:02.184801 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 287/575] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:02.189647 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60251d-2e56-4e67-90c9-3030b1a267ba None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:02.260760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6162d-61ee-48a3-af77-009d70cce94a None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:02.296156 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24516667-b58c-4285-becb-976002bf9472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:02.296375 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24516667-b58c-4285-becb-976002bf9472 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:02.296645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24516667-b58c-4285-becb-976002bf9472 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:02.296915 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24516667-b58c-4285-becb-976002bf9472 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:02.297554 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24516667-b58c-4285-becb-976002bf9472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:02.297859 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24516667-b58c-4285-becb-976002bf9472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:02.299264 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24516667-b58c-4285-becb-976002bf9472 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:02.311068 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60251d-2e56-4e67-90c9-3030b1a267ba None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:02.316664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 289/576] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:02.317687 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24516667-b58c-4285-becb-976002bf9472 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:02.347546 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:02.364350 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b339b-571d-49e3-b5db-7cb612505d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:02.365272 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b339b-571d-49e3-b5db-7cb612505d43 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:02.366540 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b339b-571d-49e3-b5db-7cb612505d43 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:02.367018 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b339b-571d-49e3-b5db-7cb612505d43 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:02.368404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b339b-571d-49e3-b5db-7cb612505d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:02.368860 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b339b-571d-49e3-b5db-7cb612505d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:02.370486 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b339b-571d-49e3-b5db-7cb612505d43 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:02.387516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 288/577] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:02.393162 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b339b-571d-49e3-b5db-7cb612505d43 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:02.410961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:02.448530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24516667-b58c-4285-becb-976002bf9472 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:02.491160 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397dbfe-cdf4-4ddb-bf1b-6ec298da94bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:02.493350 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397dbfe-cdf4-4ddb-bf1b-6ec298da94bb None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:02.494096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397dbfe-cdf4-4ddb-bf1b-6ec298da94bb None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:02.494649 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397dbfe-cdf4-4ddb-bf1b-6ec298da94bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:02.504462 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397dbfe-cdf4-4ddb-bf1b-6ec298da94bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:02.507108 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397dbfe-cdf4-4ddb-bf1b-6ec298da94bb None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:02.517302 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b339b-571d-49e3-b5db-7cb612505d43 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-9397dbfe-cdf4-4ddb-bf1b-6ec298da94bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:54:02.522710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:02.523798 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:02.524847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:54:02.524847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:54:02.524847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:54:02.524847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:54:02.524847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:54:02.524847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:54:02.524847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:02.524847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:02.527293 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 290/578] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:02.532388 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397dbfe-cdf4-4ddb-bf1b-6ec298da94bb None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:02.560789 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8502e96-ac6d-476c-92ba-5f6decd53b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:02.561823 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8502e96-ac6d-476c-92ba-5f6decd53b3c None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:02.562396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8502e96-ac6d-476c-92ba-5f6decd53b3c None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:02.562955 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8502e96-ac6d-476c-92ba-5f6decd53b3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:02.570617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8502e96-ac6d-476c-92ba-5f6decd53b3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:02.572428 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8502e96-ac6d-476c-92ba-5f6decd53b3c None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-b8502e96-ac6d-476c-92ba-5f6decd53b3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:54:02.585290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:02.586984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:02.588072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:54:02.588072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:54:02.588072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:54:02.588072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:54:02.588072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:54:02.588072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:54:02.588072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:02.588072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:02.594899 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 289/579] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:02.596304 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8502e96-ac6d-476c-92ba-5f6decd53b3c None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:02.619185 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:02.639066 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397dbfe-cdf4-4ddb-bf1b-6ec298da94bb None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:02.680706 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4643e-57e7-40f5-85d0-964549c08a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:02.681450 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4643e-57e7-40f5-85d0-964549c08a65 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:02.681728 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4643e-57e7-40f5-85d0-964549c08a65 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:02.682010 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4643e-57e7-40f5-85d0-964549c08a65 None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:02.682809 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4643e-57e7-40f5-85d0-964549c08a65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:02.683116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4643e-57e7-40f5-85d0-964549c08a65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:02.684526 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4643e-57e7-40f5-85d0-964549c08a65 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:02.691454 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:02.704052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 291/580] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:54:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:02.704897 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4643e-57e7-40f5-85d0-964549c08a65 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:02.737799 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8502e96-ac6d-476c-92ba-5f6decd53b3c None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:02.783186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bc1fc-cf0d-4dc6-8a93-063435a2f021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:02.784608 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bc1fc-cf0d-4dc6-8a93-063435a2f021 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:02.785189 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bc1fc-cf0d-4dc6-8a93-063435a2f021 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:02.785720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bc1fc-cf0d-4dc6-8a93-063435a2f021 None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:02.786875 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bc1fc-cf0d-4dc6-8a93-063435a2f021 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:02.787336 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bc1fc-cf0d-4dc6-8a93-063435a2f021 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:02.790580 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bc1fc-cf0d-4dc6-8a93-063435a2f021 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:02.812087 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 290/581] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:54:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:02.813804 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bc1fc-cf0d-4dc6-8a93-063435a2f021 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:02.826809 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4643e-57e7-40f5-85d0-964549c08a65 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:02.866846 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb373d8-7ada-4f76-8fa7-e647fa3f09c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:02.868226 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb373d8-7ada-4f76-8fa7-e647fa3f09c8 None admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:02.868597 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb373d8-7ada-4f76-8fa7-e647fa3f09c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:02.869014 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb373d8-7ada-4f76-8fa7-e647fa3f09c8 None admin] PATH_INFO: `/v3/projects/cac45966110b47f28339c78e693b3793/users/5c3e43e391e1470e90b21511b98b0d40/roles/6282183e8c2b48b499413483605de6fc` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:02.881275 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:02.886140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb373d8-7ada-4f76-8fa7-e647fa3f09c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=cac45966110b47f28339c78e693b3793, user_id=5c3e43e391e1470e90b21511b98b0d40, role_id=6282183e8c2b48b499413483605de6fc)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:02.887717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb373d8-7ada-4f76-8fa7-e647fa3f09c8 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:02.945160 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bc1fc-cf0d-4dc6-8a93-063435a2f021 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:02.976982 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:02.983067 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60653a-b1dc-41d4-9aa5-659b64cac586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:02.983732 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60653a-b1dc-41d4-9aa5-659b64cac586 None admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:02.984025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60653a-b1dc-41d4-9aa5-659b64cac586 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:02.984277 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60653a-b1dc-41d4-9aa5-659b64cac586 None admin] PATH_INFO: `/v3/projects/cac45966110b47f28339c78e693b3793/users/1308dea6ef324bf388a0339ca911f36c/roles/6282183e8c2b48b499413483605de6fc` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:02.999543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60653a-b1dc-41d4-9aa5-659b64cac586 None admin] RBAC: Authorizing `identity:create_grant(project_id=cac45966110b47f28339c78e693b3793, user_id=1308dea6ef324bf388a0339ca911f36c, role_id=6282183e8c2b48b499413483605de6fc)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:03.000992 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60653a-b1dc-41d4-9aa5-659b64cac586 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:03.223262 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 292/582] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:54:02 2022] PUT /identity/v3/projects/cac45966110b47f28339c78e693b3793/users/5c3e43e391e1470e90b21511b98b0d40/roles/6282183e8c2b48b499413483605de6fc => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 14:54:03.252294 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 291/583] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:54:02 2022] PUT /identity/v3/projects/cac45966110b47f28339c78e693b3793/users/1308dea6ef324bf388a0339ca911f36c/roles/6282183e8c2b48b499413483605de6fc => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:54:03.721014 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6b9f-767b-48ad-8f44-467b03b39bf9 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:03.721561 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6b9f-767b-48ad-8f44-467b03b39bf9 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:03.721561 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6b9f-767b-48ad-8f44-467b03b39bf9 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:03.723132 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 293/584] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:03.729131 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edb859-5c0c-4521-89a9-8a6eed30f963 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:03.729584 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edb859-5c0c-4521-89a9-8a6eed30f963 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:03.729676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edb859-5c0c-4521-89a9-8a6eed30f963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:03.748610 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-66edb859-5c0c-4521-89a9-8a6eed30f963 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:03.749815 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-66edb859-5c0c-4521-89a9-8a6eed30f963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:03.823690 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 292/585] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:54:04.149625 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6b9f-767b-48ad-8f44-467b03b39bf9 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:04.206660 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ed9ae-1a3d-4a5f-b870-3bde1587bb80 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:04.207003 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ed9ae-1a3d-4a5f-b870-3bde1587bb80 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:04.207214 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ed9ae-1a3d-4a5f-b870-3bde1587bb80 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:04.208800 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 293/586] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:04.214686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aec046-d342-4c36-962f-72ce373c3bd3 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:04.214972 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aec046-d342-4c36-962f-72ce373c3bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:04.215251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aec046-d342-4c36-962f-72ce373c3bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:04.238537 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-08aec046-d342-4c36-962f-72ce373c3bd3 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:04.240043 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-08aec046-d342-4c36-962f-72ce373c3bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:04.264040 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6b9f-767b-48ad-8f44-467b03b39bf9 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:04.301718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b91aee-1d45-4680-9046-1412cfc0efcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:04.302691 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91aee-1d45-4680-9046-1412cfc0efcb None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:04.303160 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91aee-1d45-4680-9046-1412cfc0efcb None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:04.303760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91aee-1d45-4680-9046-1412cfc0efcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:04.316271 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b91aee-1d45-4680-9046-1412cfc0efcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-a0b91aee-1d45-4680-9046-1412cfc0efcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:54:04.321553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:04.322544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:04.323412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:04.323412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:04.323412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:04.323412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:04.323412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:54:04.323412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:54:04.323412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:54:04.323412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:54:04.323412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:54:04.323412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:54:04.323412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:54:04.323412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:04.326341 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 294/588] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:54:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:04.330366 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 294/588] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:54:04.331675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b91aee-1d45-4680-9046-1412cfc0efcb None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:04.386427 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:04.447393 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b91aee-1d45-4680-9046-1412cfc0efcb None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:04.484104 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277801d-25f0-4245-928e-eab2d2f54f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:04.491243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277801d-25f0-4245-928e-eab2d2f54f98 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:04.491243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277801d-25f0-4245-928e-eab2d2f54f98 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:04.491243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277801d-25f0-4245-928e-eab2d2f54f98 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:04.491243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277801d-25f0-4245-928e-eab2d2f54f98 None admin] RBAC: Adding query filter params (name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:04.491243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277801d-25f0-4245-928e-eab2d2f54f98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:04.491243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277801d-25f0-4245-928e-eab2d2f54f98 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:04.496213 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 295/589] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:54:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:04.502572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aec046-d342-4c36-962f-72ce373c3bd3 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:04.545951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:04.604924 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aec046-d342-4c36-962f-72ce373c3bd3 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:04.640784 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5e650-4b0b-4d24-97c6-5582250fd2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:04.641399 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5e650-4b0b-4d24-97c6-5582250fd2f1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:04.641679 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5e650-4b0b-4d24-97c6-5582250fd2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:04.641947 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5e650-4b0b-4d24-97c6-5582250fd2f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:04.652587 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5e650-4b0b-4d24-97c6-5582250fd2f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:04.654024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5e650-4b0b-4d24-97c6-5582250fd2f1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-18b5e650-4b0b-4d24-97c6-5582250fd2f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:04.670402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:04.671509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:04.672655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:04.672655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:04.672655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:04.672655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 295/590] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:04.677314 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277801d-25f0-4245-928e-eab2d2f54f98 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:04.699893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5e650-4b0b-4d24-97c6-5582250fd2f1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:04.801477 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:04.811115 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277801d-25f0-4245-928e-eab2d2f54f98 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:04.814519 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5e650-4b0b-4d24-97c6-5582250fd2f1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:04.827849 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:04.863001 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fd5bd-6041-4e0c-ace1-7bd1c726e84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:04.863714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fd5bd-6041-4e0c-ace1-7bd1c726e84c None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:04.864088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fd5bd-6041-4e0c-ace1-7bd1c726e84c None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:04.864397 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fd5bd-6041-4e0c-ace1-7bd1c726e84c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:04.865351 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a2ddf-6b1e-48a0-887d-6a06a151b749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:04.866213 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a2ddf-6b1e-48a0-887d-6a06a151b749 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:04.866707 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a2ddf-6b1e-48a0-887d-6a06a151b749 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:04.867192 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a2ddf-6b1e-48a0-887d-6a06a151b749 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:04.868017 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a2ddf-6b1e-48a0-887d-6a06a151b749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:04.868496 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a2ddf-6b1e-48a0-887d-6a06a151b749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:04.870047 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a2ddf-6b1e-48a0-887d-6a06a151b749 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:04.876580 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fd5bd-6041-4e0c-ace1-7bd1c726e84c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-745fd5bd-6041-4e0c-ace1-7bd1c726e84c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:54:04.883354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:04.884449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:04.885816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:04.885816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:04.885816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:04.885816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:04.885816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:54:04.885816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:54:04.885816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:54:04.885816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:54:04.885816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:54:04.885816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:54:04.885816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:54:04.885816 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:04.891919 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 296/591] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:54:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:04.892005 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 296/592] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:04.893081 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fd5bd-6041-4e0c-ace1-7bd1c726e84c None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:04.893616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a2ddf-6b1e-48a0-887d-6a06a151b749 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:05.004803 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a2ddf-6b1e-48a0-887d-6a06a151b749 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:05.036486 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fd5bd-6041-4e0c-ace1-7bd1c726e84c None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:05.047897 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758cae0-3328-422e-bcd1-39d67221c86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:05.048879 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758cae0-3328-422e-bcd1-39d67221c86d None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.049353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758cae0-3328-422e-bcd1-39d67221c86d None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.049830 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758cae0-3328-422e-bcd1-39d67221c86d None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.050735 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758cae0-3328-422e-bcd1-39d67221c86d None admin] RBAC: Adding query filter params (name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:05.051227 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758cae0-3328-422e-bcd1-39d67221c86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:05.053024 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758cae0-3328-422e-bcd1-39d67221c86d None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:05.067864 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 297/593] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:54:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:05.069428 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758cae0-3328-422e-bcd1-39d67221c86d None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:05.080792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a731cd-3358-4b2c-8dae-12464d655a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:05.082018 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a731cd-3358-4b2c-8dae-12464d655a98 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.082397 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a731cd-3358-4b2c-8dae-12464d655a98 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.082735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a731cd-3358-4b2c-8dae-12464d655a98 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.094185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a731cd-3358-4b2c-8dae-12464d655a98 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:05.096296 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a731cd-3358-4b2c-8dae-12464d655a98 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:05.111118 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-40a731cd-3358-4b2c-8dae-12464d655a98 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:54:05.114186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:05.115343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:05.116504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:05.116504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:05.116504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:54:05.116504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:54:05.116504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:54:05.116504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:54:05.116504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:54:05.116504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:54:05.116504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 14:54:05.116504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:05.118416 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 297/594] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:54:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:05.127864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a731cd-3358-4b2c-8dae-12464d655a98 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:05.150329 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:05.204671 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758cae0-3328-422e-bcd1-39d67221c86d None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:05.242702 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8098c7-8d5c-4a25-9ffd-5749bb123048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:05.243408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8098c7-8d5c-4a25-9ffd-5749bb123048 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.243763 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8098c7-8d5c-4a25-9ffd-5749bb123048 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.244098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8098c7-8d5c-4a25-9ffd-5749bb123048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.254890 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a731cd-3358-4b2c-8dae-12464d655a98 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:05.255046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8098c7-8d5c-4a25-9ffd-5749bb123048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:05.256374 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8098c7-8d5c-4a25-9ffd-5749bb123048 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-8d8098c7-8d5c-4a25-9ffd-5749bb123048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:05.271761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:05.272753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:05.274173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:05.274173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:05.274173 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:05.278413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 298/595] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:05.279351 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8098c7-8d5c-4a25-9ffd-5749bb123048 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:05.295948 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e7429-5a2c-4cbe-ba97-4932e72a8a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:05.296840 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e7429-5a2c-4cbe-ba97-4932e72a8a49 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.297296 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e7429-5a2c-4cbe-ba97-4932e72a8a49 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.297764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e7429-5a2c-4cbe-ba97-4932e72a8a49 None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.298716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e7429-5a2c-4cbe-ba97-4932e72a8a49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:05.299196 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e7429-5a2c-4cbe-ba97-4932e72a8a49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:05.300794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e7429-5a2c-4cbe-ba97-4932e72a8a49 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:05.319602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 298/596] 10.222.0.52 () {56 vars in 1137 bytes} [Wed Aug 31 14:54:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:05.326352 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e7429-5a2c-4cbe-ba97-4932e72a8a49 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:05.375633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:05.391930 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8098c7-8d5c-4a25-9ffd-5749bb123048 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:05.404219 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:05.435008 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d8f76-9ab4-4ed4-b92b-cf9b71df9901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:05.435843 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d8f76-9ab4-4ed4-b92b-cf9b71df9901 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.436167 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d8f76-9ab4-4ed4-b92b-cf9b71df9901 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.436503 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d8f76-9ab4-4ed4-b92b-cf9b71df9901 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.437245 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d8f76-9ab4-4ed4-b92b-cf9b71df9901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:05.437815 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d8f76-9ab4-4ed4-b92b-cf9b71df9901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:05.439095 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d8f76-9ab4-4ed4-b92b-cf9b71df9901 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:05.444536 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e7429-5a2c-4cbe-ba97-4932e72a8a49 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:05.457883 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 299/597] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:05.458750 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d8f76-9ab4-4ed4-b92b-cf9b71df9901 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:05.483794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdf47d-23ea-4192-9d2b-7d8600f39b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:05.484718 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdf47d-23ea-4192-9d2b-7d8600f39b30 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.485200 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdf47d-23ea-4192-9d2b-7d8600f39b30 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.485654 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdf47d-23ea-4192-9d2b-7d8600f39b30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.557008 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdf47d-23ea-4192-9d2b-7d8600f39b30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:05.558825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdf47d-23ea-4192-9d2b-7d8600f39b30 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:05.572813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d8f76-9ab4-4ed4-b92b-cf9b71df9901 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:05.607069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c6765-ebb2-40e0-b0b9-f466d6496bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:05.607702 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c6765-ebb2-40e0-b0b9-f466d6496bf8 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.608239 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c6765-ebb2-40e0-b0b9-f466d6496bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.608514 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c6765-ebb2-40e0-b0b9-f466d6496bf8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.616777 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c6765-ebb2-40e0-b0b9-f466d6496bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:05.618986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c6765-ebb2-40e0-b0b9-f466d6496bf8 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-bc6c6765-ebb2-40e0-b0b9-f466d6496bf8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:54:05.630045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:05.631030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:05.631953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:05.631953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:05.631953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:54:05.631953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:54:05.631953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:54:05.631953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:54:05.631953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:54:05.631953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:54:05.631953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 14:54:05.631953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:05.631953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 300/598] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 31 14:54:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:05.632537 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba72ef-29de-4cb2-aa3c-5d7e1661e402 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.632667 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba72ef-29de-4cb2-aa3c-5d7e1661e402 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.633108 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba72ef-29de-4cb2-aa3c-5d7e1661e402 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.633884 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:05.637258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 301/599] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:05.637258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2596-0a92-4ca3-820a-5564252d32fe None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.637258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2596-0a92-4ca3-820a-5564252d32fe None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.637258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2596-0a92-4ca3-820a-5564252d32fe None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.637258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 302/600] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:05.637986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2596-0a92-4ca3-820a-5564252d32fe None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:05.647717 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:05.671417 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 299/601] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 14:54:05.672772 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a425a-c3fa-4e1d-8f6d-b0976b4f03e7 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.673022 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a425a-c3fa-4e1d-8f6d-b0976b4f03e7 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.673301 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a425a-c3fa-4e1d-8f6d-b0976b4f03e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.691109 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-475a425a-c3fa-4e1d-8f6d-b0976b4f03e7 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:05.692321 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-475a425a-c3fa-4e1d-8f6d-b0976b4f03e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:05.744625 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2596-0a92-4ca3-820a-5564252d32fe None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:05.758337 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 300/602] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:54:05.759695 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f930506-41a2-4f6a-80b4-0bcce2911b76 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.759984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f930506-41a2-4f6a-80b4-0bcce2911b76 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.760258 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f930506-41a2-4f6a-80b4-0bcce2911b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.778770 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-1f930506-41a2-4f6a-80b4-0bcce2911b76 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:05.779062 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8894f-e47a-4956-a8cb-5e91ebfcd233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:05.779695 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8894f-e47a-4956-a8cb-5e91ebfcd233 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.779958 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-1f930506-41a2-4f6a-80b4-0bcce2911b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:05.780058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8894f-e47a-4956-a8cb-5e91ebfcd233 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.780237 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8894f-e47a-4956-a8cb-5e91ebfcd233 None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.780957 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8894f-e47a-4956-a8cb-5e91ebfcd233 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:05.781264 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8894f-e47a-4956-a8cb-5e91ebfcd233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:05.782702 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8894f-e47a-4956-a8cb-5e91ebfcd233 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:05.801375 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 303/603] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 31 14:54:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:05.802255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8894f-e47a-4956-a8cb-5e91ebfcd233 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:05.861645 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 301/604] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:54:05.863083 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f930506-41a2-4f6a-80b4-0bcce2911b76 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:05.878032 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:05.907538 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:05.925126 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8894f-e47a-4956-a8cb-5e91ebfcd233 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:05.963051 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bfb49-c983-4bfe-9362-a760a6d79c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:05.964247 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bfb49-c983-4bfe-9362-a760a6d79c48 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:05.964750 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bfb49-c983-4bfe-9362-a760a6d79c48 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:05.965259 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bfb49-c983-4bfe-9362-a760a6d79c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:05.977344 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bfb49-c983-4bfe-9362-a760a6d79c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:05.979210 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bfb49-c983-4bfe-9362-a760a6d79c48 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:05.988202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f930506-41a2-4f6a-80b4-0bcce2911b76 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-a39bfb49-c983-4bfe-9362-a760a6d79c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:05.995865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:05.996825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:05.997715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:05.997715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:05.997715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:06.004245 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 304/605] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:06.005434 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bfb49-c983-4bfe-9362-a760a6d79c48 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:06.027136 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea439cf0-06e3-458e-9c50-9bef7a27b7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:06.027745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea439cf0-06e3-458e-9c50-9bef7a27b7dc None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:06.028648 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea439cf0-06e3-458e-9c50-9bef7a27b7dc None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:06.028648 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea439cf0-06e3-458e-9c50-9bef7a27b7dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:06.104481 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea439cf0-06e3-458e-9c50-9bef7a27b7dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:06.105852 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea439cf0-06e3-458e-9c50-9bef7a27b7dc None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:06.119013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bfb49-c983-4bfe-9362-a760a6d79c48 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:06.136494 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:06.138659 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:06.154767 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207797a-266b-4402-9d8f-5e5553224b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:06.155371 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207797a-266b-4402-9d8f-5e5553224b0a None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:06.155656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207797a-266b-4402-9d8f-5e5553224b0a None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:06.155925 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207797a-266b-4402-9d8f-5e5553224b0a None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:06.156561 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207797a-266b-4402-9d8f-5e5553224b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:06.156866 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207797a-266b-4402-9d8f-5e5553224b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:06.158204 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207797a-266b-4402-9d8f-5e5553224b0a None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:06.169634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 305/606] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:06.170464 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207797a-266b-4402-9d8f-5e5553224b0a None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:06.227034 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 302/607] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:54:06.227861 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea439cf0-06e3-458e-9c50-9bef7a27b7dc None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:06.273063 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207797a-266b-4402-9d8f-5e5553224b0a None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:06.306926 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cc195-45ed-488e-9dc7-b40ee6c7c341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:06.307555 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cc195-45ed-488e-9dc7-b40ee6c7c341 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:06.307834 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cc195-45ed-488e-9dc7-b40ee6c7c341 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:06.308105 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cc195-45ed-488e-9dc7-b40ee6c7c341 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:06.318067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cc195-45ed-488e-9dc7-b40ee6c7c341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-dd3cc195-45ed-488e-9dc7-b40ee6c7c341 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:54:06.323673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:06.324633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:06.325470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 306/608] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:54:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:06.326171 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cc195-45ed-488e-9dc7-b40ee6c7c341 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:06.328426 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea439cf0-06e3-458e-9c50-9bef7a27b7dc None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:06.356453 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:06.361712 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:06.362257 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26556892-7001-43c8-add5-7deb86e27899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:06.362901 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26556892-7001-43c8-add5-7deb86e27899 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:06.366638 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26556892-7001-43c8-add5-7deb86e27899 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:06.366638 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26556892-7001-43c8-add5-7deb86e27899 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:06.369962 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26556892-7001-43c8-add5-7deb86e27899 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:06.371421 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26556892-7001-43c8-add5-7deb86e27899 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-26556892-7001-43c8-add5-7deb86e27899 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:54:06.382585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:06.384479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:06.385686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:54:06.385686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:54:06.385686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:54:06.385686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:54:06.385686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:54:06.385686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:54:06.385686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:06.385686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:06.385686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 303/609] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:06.385686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26556892-7001-43c8-add5-7deb86e27899 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:06.429358 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cc195-45ed-488e-9dc7-b40ee6c7c341 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:06.464128 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b59787-8ec7-4e8c-ac86-27616a25f4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:06.464748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b59787-8ec7-4e8c-ac86-27616a25f4f3 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:06.465028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b59787-8ec7-4e8c-ac86-27616a25f4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:06.465298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b59787-8ec7-4e8c-ac86-27616a25f4f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:06.475084 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b59787-8ec7-4e8c-ac86-27616a25f4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-84b59787-8ec7-4e8c-ac86-27616a25f4f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:54:06.480256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:06.481306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 307/610] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:54:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:06.482124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b59787-8ec7-4e8c-ac86-27616a25f4f3 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:06.486698 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26556892-7001-43c8-add5-7deb86e27899 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:06.521216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53620ebd-0d34-4886-9ed8-d79e8c2e30a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:06.521834 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53620ebd-0d34-4886-9ed8-d79e8c2e30a3 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:06.522113 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53620ebd-0d34-4886-9ed8-d79e8c2e30a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:06.522416 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53620ebd-0d34-4886-9ed8-d79e8c2e30a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:06.533159 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53620ebd-0d34-4886-9ed8-d79e8c2e30a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:06.534634 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53620ebd-0d34-4886-9ed8-d79e8c2e30a3 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-53620ebd-0d34-4886-9ed8-d79e8c2e30a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:06.548371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:06.549328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:06.550609 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:06.550609 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:06.550609 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:06.550609 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 304/611] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:06.550609 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53620ebd-0d34-4886-9ed8-d79e8c2e30a3 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:06.579863 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:06.585406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b59787-8ec7-4e8c-ac86-27616a25f4f3 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:06.593112 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:06.619833 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b076a9-42d7-432f-bbe5-616fef2ff502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:06.620384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b076a9-42d7-432f-bbe5-616fef2ff502 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:06.620663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b076a9-42d7-432f-bbe5-616fef2ff502 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:06.620936 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b076a9-42d7-432f-bbe5-616fef2ff502 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:06.621636 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b076a9-42d7-432f-bbe5-616fef2ff502 None admin] RBAC: Adding query filter params (name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:06.621941 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b076a9-42d7-432f-bbe5-616fef2ff502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:06.623419 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b076a9-42d7-432f-bbe5-616fef2ff502 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:06.631449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 308/612] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:54:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:06.632238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b076a9-42d7-432f-bbe5-616fef2ff502 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:06.655851 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53620ebd-0d34-4886-9ed8-d79e8c2e30a3 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:06.693490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede17c5-ca6e-4c60-9cfd-8a31a7d4b9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:06.694087 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede17c5-ca6e-4c60-9cfd-8a31a7d4b9c3 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:06.694401 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede17c5-ca6e-4c60-9cfd-8a31a7d4b9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:06.694673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede17c5-ca6e-4c60-9cfd-8a31a7d4b9c3 None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:06.695876 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede17c5-ca6e-4c60-9cfd-8a31a7d4b9c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:06.696177 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede17c5-ca6e-4c60-9cfd-8a31a7d4b9c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:06.697595 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede17c5-ca6e-4c60-9cfd-8a31a7d4b9c3 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:06.709681 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 305/613] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:06.710490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede17c5-ca6e-4c60-9cfd-8a31a7d4b9c3 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:06.733943 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b076a9-42d7-432f-bbe5-616fef2ff502 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:06.769490 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63e750-dea7-4415-957c-d64f9dbb0a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:06.770093 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63e750-dea7-4415-957c-d64f9dbb0a12 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:06.770404 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63e750-dea7-4415-957c-d64f9dbb0a12 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:06.770673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63e750-dea7-4415-957c-d64f9dbb0a12 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:06.771325 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63e750-dea7-4415-957c-d64f9dbb0a12 None admin] RBAC: Adding query filter params (name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:06.771668 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63e750-dea7-4415-957c-d64f9dbb0a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:06.773013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63e750-dea7-4415-957c-d64f9dbb0a12 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:06.781486 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 309/614] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:54:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:06.782269 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63e750-dea7-4415-957c-d64f9dbb0a12 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:06.806580 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:06.809426 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede17c5-ca6e-4c60-9cfd-8a31a7d4b9c3 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:06.810986 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:06.842744 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f2625-a45d-4266-890e-cfcaacbc76e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:06.843504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f2625-a45d-4266-890e-cfcaacbc76e8 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:06.843893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f2625-a45d-4266-890e-cfcaacbc76e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:06.844291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f2625-a45d-4266-890e-cfcaacbc76e8 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:06.847668 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f2625-a45d-4266-890e-cfcaacbc76e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:06.847668 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f2625-a45d-4266-890e-cfcaacbc76e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:06.847668 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f2625-a45d-4266-890e-cfcaacbc76e8 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:06.859620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 306/615] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:06.860436 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f2625-a45d-4266-890e-cfcaacbc76e8 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:06.893156 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63e750-dea7-4415-957c-d64f9dbb0a12 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:06.926871 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b8342-9e53-4f67-b556-4c87cf93509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:06.927492 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b8342-9e53-4f67-b556-4c87cf93509b None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:06.927769 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b8342-9e53-4f67-b556-4c87cf93509b None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:06.928040 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b8342-9e53-4f67-b556-4c87cf93509b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:06.939537 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b8342-9e53-4f67-b556-4c87cf93509b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:06.940972 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b8342-9e53-4f67-b556-4c87cf93509b None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-992b8342-9e53-4f67-b556-4c87cf93509b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:06.955052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:06.956200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:06.957693 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:06.957693 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:06.957693 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:06.957693 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 310/616] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:06.957693 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b8342-9e53-4f67-b556-4c87cf93509b None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:06.973646 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f2625-a45d-4266-890e-cfcaacbc76e8 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:07.008413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81a734-2836-4321-8832-8c03dbe751a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:07.009003 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81a734-2836-4321-8832-8c03dbe751a0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:07.009274 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81a734-2836-4321-8832-8c03dbe751a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:07.009544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81a734-2836-4321-8832-8c03dbe751a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:07.010247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81a734-2836-4321-8832-8c03dbe751a0 None admin] RBAC: Adding query filter params (role.id=6282183e8c2b48b499413483605de6fc, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=7e0027b550fa4eaaa3f95da115d7da02) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:07.013298 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81a734-2836-4321-8832-8c03dbe751a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:07.013298 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81a734-2836-4321-8832-8c03dbe751a0 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:07.030172 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:07.042368 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 307/617] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:54:06 2022] GET /identity/v3/role_assignments?user.id=7e0027b550fa4eaaa3f95da115d7da02&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=6282183e8c2b48b499413483605de6fc => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:07.043175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81a734-2836-4321-8832-8c03dbe751a0 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:07.064773 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b8342-9e53-4f67-b556-4c87cf93509b None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:07.076360 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:07.109166 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e7609-5192-4046-8063-07d61ed936b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:07.110278 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e7609-5192-4046-8063-07d61ed936b9 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:07.110689 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e7609-5192-4046-8063-07d61ed936b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:07.111069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e7609-5192-4046-8063-07d61ed936b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:07.128477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e7609-5192-4046-8063-07d61ed936b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:07.130149 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e7609-5192-4046-8063-07d61ed936b9 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-657e7609-5192-4046-8063-07d61ed936b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:07.151826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:07.153023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:07.154125 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:07.154125 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:07.154125 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:07.161173 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81a734-2836-4321-8832-8c03dbe751a0 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:07.161803 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 311/618] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:07.162887 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e7609-5192-4046-8063-07d61ed936b9 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:07.205977 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464373fd-7c36-4f81-ae03-42ce8b0d20fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:07.206654 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464373fd-7c36-4f81-ae03-42ce8b0d20fe None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:07.206939 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464373fd-7c36-4f81-ae03-42ce8b0d20fe None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:07.207211 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464373fd-7c36-4f81-ae03-42ce8b0d20fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:07.216183 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464373fd-7c36-4f81-ae03-42ce8b0d20fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:07.217654 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464373fd-7c36-4f81-ae03-42ce8b0d20fe None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-464373fd-7c36-4f81-ae03-42ce8b0d20fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:54:07.231094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:07.232192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:07.233534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:54:07.233534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:54:07.233534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:54:07.233534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:54:07.233534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:54:07.233534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:54:07.233534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:07.233534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:07.233534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 308/619] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:07.233534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464373fd-7c36-4f81-ae03-42ce8b0d20fe None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:07.287759 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e7609-5192-4046-8063-07d61ed936b9 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:07.316326 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:07.334706 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85ea17-fee3-42c4-8b44-32fe086a1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:07.335313 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85ea17-fee3-42c4-8b44-32fe086a1e85 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:07.335665 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85ea17-fee3-42c4-8b44-32fe086a1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:07.336464 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85ea17-fee3-42c4-8b44-32fe086a1e85 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:07.337043 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85ea17-fee3-42c4-8b44-32fe086a1e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:07.337342 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85ea17-fee3-42c4-8b44-32fe086a1e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:07.337871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:07.338744 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85ea17-fee3-42c4-8b44-32fe086a1e85 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:07.354348 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 312/620] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:07.354348 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85ea17-fee3-42c4-8b44-32fe086a1e85 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:07.360115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464373fd-7c36-4f81-ae03-42ce8b0d20fe None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:07.403685 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea93b8-7657-466d-90e7-594d9fef195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:07.404523 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea93b8-7657-466d-90e7-594d9fef195e None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:07.404971 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea93b8-7657-466d-90e7-594d9fef195e None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:07.405378 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea93b8-7657-466d-90e7-594d9fef195e None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:07.406169 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea93b8-7657-466d-90e7-594d9fef195e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:07.406505 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea93b8-7657-466d-90e7-594d9fef195e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:07.407864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea93b8-7657-466d-90e7-594d9fef195e None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:07.420850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 309/621] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:07.421468 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea93b8-7657-466d-90e7-594d9fef195e None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:07.465372 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85ea17-fee3-42c4-8b44-32fe086a1e85 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:07.501962 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3e9d6-e146-4eb3-8cbd-8f7941d83fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:07.504491 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3e9d6-e146-4eb3-8cbd-8f7941d83fa1 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:07.504875 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3e9d6-e146-4eb3-8cbd-8f7941d83fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:07.505250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3e9d6-e146-4eb3-8cbd-8f7941d83fa1 None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:07.507384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3e9d6-e146-4eb3-8cbd-8f7941d83fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:07.507889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3e9d6-e146-4eb3-8cbd-8f7941d83fa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:07.509472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3e9d6-e146-4eb3-8cbd-8f7941d83fa1 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:07.527697 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 313/622] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:54:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:07.527697 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3e9d6-e146-4eb3-8cbd-8f7941d83fa1 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:07.537534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea93b8-7657-466d-90e7-594d9fef195e None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:07.575468 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:07.577705 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de932465-de21-4a70-a0ee-34ea15eb9e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:07.578363 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de932465-de21-4a70-a0ee-34ea15eb9e6f None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:07.579397 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de932465-de21-4a70-a0ee-34ea15eb9e6f None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:07.579397 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de932465-de21-4a70-a0ee-34ea15eb9e6f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:07.588201 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de932465-de21-4a70-a0ee-34ea15eb9e6f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:07.589671 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de932465-de21-4a70-a0ee-34ea15eb9e6f None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-de932465-de21-4a70-a0ee-34ea15eb9e6f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:54:07.601080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:07.602761 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:07.603740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:07.603740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:07.603740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:54:07.603740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:54:07.603740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:54:07.603740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:54:07.603740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:54:07.603740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:54:07.603740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 14:54:07.603740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:07.603740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 310/623] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:54:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:07.604332 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de932465-de21-4a70-a0ee-34ea15eb9e6f None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:07.617013 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:07.643305 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3e9d6-e146-4eb3-8cbd-8f7941d83fa1 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:07.677537 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672243a-d8c6-440d-957c-da887a59c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:07.678090 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672243a-d8c6-440d-957c-da887a59c76b None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:07.678394 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672243a-d8c6-440d-957c-da887a59c76b None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:07.678665 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672243a-d8c6-440d-957c-da887a59c76b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:07.686745 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672243a-d8c6-440d-957c-da887a59c76b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:07.688185 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672243a-d8c6-440d-957c-da887a59c76b None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-b672243a-d8c6-440d-957c-da887a59c76b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:54:07.699174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:07.700294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:07.701408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:07.701408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:07.701408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:54:07.701408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:54:07.701408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:54:07.701408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:54:07.701408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:54:07.701408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:54:07.701408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 14:54:07.701408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:07.705148 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 314/624] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:54:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:07.705990 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672243a-d8c6-440d-957c-da887a59c76b None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:07.718126 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de932465-de21-4a70-a0ee-34ea15eb9e6f None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:07.755659 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5ef89-5e19-4880-b29a-0aadc6af2fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:07.756350 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5ef89-5e19-4880-b29a-0aadc6af2fad None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:07.756633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5ef89-5e19-4880-b29a-0aadc6af2fad None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:07.756898 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5ef89-5e19-4880-b29a-0aadc6af2fad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:07.757625 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5ef89-5e19-4880-b29a-0aadc6af2fad None admin] RBAC: Adding query filter params (role.id=6282183e8c2b48b499413483605de6fc, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=98bb7c83115a45f1bdf9f48c6599db18) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:07.757934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5ef89-5e19-4880-b29a-0aadc6af2fad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:07.759506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5ef89-5e19-4880-b29a-0aadc6af2fad None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:07.766114 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 311/625] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:54:07 2022] GET /identity/v3/role_assignments?user.id=98bb7c83115a45f1bdf9f48c6599db18&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=6282183e8c2b48b499413483605de6fc => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:07.766941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5ef89-5e19-4880-b29a-0aadc6af2fad None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:07.827253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672243a-d8c6-440d-957c-da887a59c76b None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:07.829952 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:07.865459 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:07.876404 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9304f3f-cfcd-4b73-8b83-0e5e6131e539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:07.877320 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9304f3f-cfcd-4b73-8b83-0e5e6131e539 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:07.878072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9304f3f-cfcd-4b73-8b83-0e5e6131e539 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:07.878274 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9304f3f-cfcd-4b73-8b83-0e5e6131e539 None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:07.879212 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9304f3f-cfcd-4b73-8b83-0e5e6131e539 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:07.879659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9304f3f-cfcd-4b73-8b83-0e5e6131e539 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:07.881319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9304f3f-cfcd-4b73-8b83-0e5e6131e539 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:07.903578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 315/626] 10.222.0.52 () {56 vars in 1137 bytes} [Wed Aug 31 14:54:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:07.909701 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9304f3f-cfcd-4b73-8b83-0e5e6131e539 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:07.915623 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5ef89-5e19-4880-b29a-0aadc6af2fad None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:07.956014 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce24ac7-09b3-4ce2-aff4-311c8df2df83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:07.957359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce24ac7-09b3-4ce2-aff4-311c8df2df83 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:07.957645 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce24ac7-09b3-4ce2-aff4-311c8df2df83 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:07.958017 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce24ac7-09b3-4ce2-aff4-311c8df2df83 None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:07.958848 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce24ac7-09b3-4ce2-aff4-311c8df2df83 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:07.959215 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce24ac7-09b3-4ce2-aff4-311c8df2df83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:07.960705 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce24ac7-09b3-4ce2-aff4-311c8df2df83 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:07.985803 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 312/627] 10.222.0.52 () {56 vars in 1139 bytes} [Wed Aug 31 14:54:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:07.994896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce24ac7-09b3-4ce2-aff4-311c8df2df83 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:08.042065 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9304f3f-cfcd-4b73-8b83-0e5e6131e539 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:08.079313 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f027b6-317d-4af9-bf6f-4e8bfa6455c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:08.079925 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f027b6-317d-4af9-bf6f-4e8bfa6455c3 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:08.080202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f027b6-317d-4af9-bf6f-4e8bfa6455c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:08.080468 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f027b6-317d-4af9-bf6f-4e8bfa6455c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:08.115659 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce24ac7-09b3-4ce2-aff4-311c8df2df83 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:08.121094 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:08.153383 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:08.160461 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f027b6-317d-4af9-bf6f-4e8bfa6455c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:08.161988 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f027b6-317d-4af9-bf6f-4e8bfa6455c3 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:08.163630 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881e2bc-41ab-4ace-9240-cbdabd4f0d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:08.165002 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881e2bc-41ab-4ace-9240-cbdabd4f0d5d None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:08.165279 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881e2bc-41ab-4ace-9240-cbdabd4f0d5d None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:08.167106 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881e2bc-41ab-4ace-9240-cbdabd4f0d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:08.259769 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881e2bc-41ab-4ace-9240-cbdabd4f0d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:08.261672 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881e2bc-41ab-4ace-9240-cbdabd4f0d5d None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:08.275482 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 316/628] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:54:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 14:54:08.281016 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f027b6-317d-4af9-bf6f-4e8bfa6455c3 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:08.352194 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:08.394795 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 313/629] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:54:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 14:54:08.399948 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881e2bc-41ab-4ace-9240-cbdabd4f0d5d None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:08.408553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f027b6-317d-4af9-bf6f-4e8bfa6455c3 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:08.428314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:08.447533 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935c1f6-3ab5-456b-82dd-352cd7b634af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:08.448308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935c1f6-3ab5-456b-82dd-352cd7b634af None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:08.448687 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935c1f6-3ab5-456b-82dd-352cd7b634af None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:08.449057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935c1f6-3ab5-456b-82dd-352cd7b634af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:08.465778 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935c1f6-3ab5-456b-82dd-352cd7b634af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:08.465778 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935c1f6-3ab5-456b-82dd-352cd7b634af None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-1935c1f6-3ab5-456b-82dd-352cd7b634af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:08.482096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:08.483605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:08.484723 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:08.484723 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:08.484723 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:08.486329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 317/630] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:08.491375 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935c1f6-3ab5-456b-82dd-352cd7b634af None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:08.508604 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881e2bc-41ab-4ace-9240-cbdabd4f0d5d None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:08.545774 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003687c-591a-4dea-8f6b-6746fbe76837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:08.546359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003687c-591a-4dea-8f6b-6746fbe76837 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:08.546651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003687c-591a-4dea-8f6b-6746fbe76837 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:08.547183 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003687c-591a-4dea-8f6b-6746fbe76837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:08.558323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003687c-591a-4dea-8f6b-6746fbe76837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:08.559771 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003687c-591a-4dea-8f6b-6746fbe76837 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-1003687c-591a-4dea-8f6b-6746fbe76837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:08.575993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:08.576929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:08.577815 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:08.577815 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:08.577815 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:08.581681 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 314/631] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:08.583364 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003687c-591a-4dea-8f6b-6746fbe76837 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:08.632320 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935c1f6-3ab5-456b-82dd-352cd7b634af None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:08.653621 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:08.673042 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:08.681997 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af9cf3-5cd6-4eb7-9c2c-991ec7ed3385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:08.683034 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9cf3-5cd6-4eb7-9c2c-991ec7ed3385 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:08.683607 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9cf3-5cd6-4eb7-9c2c-991ec7ed3385 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:08.684054 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9cf3-5cd6-4eb7-9c2c-991ec7ed3385 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:08.685037 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af9cf3-5cd6-4eb7-9c2c-991ec7ed3385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:08.685820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af9cf3-5cd6-4eb7-9c2c-991ec7ed3385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:08.687822 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af9cf3-5cd6-4eb7-9c2c-991ec7ed3385 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:08.694113 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003687c-591a-4dea-8f6b-6746fbe76837 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:08.706185 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 318/632] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:08.711297 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af9cf3-5cd6-4eb7-9c2c-991ec7ed3385 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:08.733693 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a6190-7c8a-4691-b1c6-8a62c2698f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:08.734451 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6190-7c8a-4691-b1c6-8a62c2698f02 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:08.734770 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6190-7c8a-4691-b1c6-8a62c2698f02 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:08.735058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6190-7c8a-4691-b1c6-8a62c2698f02 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:08.735689 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a6190-7c8a-4691-b1c6-8a62c2698f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:08.735987 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a6190-7c8a-4691-b1c6-8a62c2698f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:08.741404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a6190-7c8a-4691-b1c6-8a62c2698f02 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:08.754411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 315/633] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:08.756645 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a6190-7c8a-4691-b1c6-8a62c2698f02 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:08.844019 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af9cf3-5cd6-4eb7-9c2c-991ec7ed3385 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:08.884700 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db3666-743b-454b-afc2-ae6efb21855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:08.885363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db3666-743b-454b-afc2-ae6efb21855b None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:08.885641 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db3666-743b-454b-afc2-ae6efb21855b None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:08.885910 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db3666-743b-454b-afc2-ae6efb21855b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:08.890124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a6190-7c8a-4691-b1c6-8a62c2698f02 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:08.893734 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db3666-743b-454b-afc2-ae6efb21855b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:08.894618 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db3666-743b-454b-afc2-ae6efb21855b None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-a5db3666-743b-454b-afc2-ae6efb21855b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:54:08.906715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:08.908069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:08.908957 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:54:08.908957 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:54:08.908957 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:54:08.908957 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:54:08.908957 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:54:08.908957 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:54:08.908957 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:08.908957 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:08.908957 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 319/634] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:08.913220 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db3666-743b-454b-afc2-ae6efb21855b None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:08.935730 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa60430-6264-4565-8ba6-8d602f3a9416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:08.936736 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa60430-6264-4565-8ba6-8d602f3a9416 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:08.937257 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa60430-6264-4565-8ba6-8d602f3a9416 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:08.937738 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa60430-6264-4565-8ba6-8d602f3a9416 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:08.944928 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa60430-6264-4565-8ba6-8d602f3a9416 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:08.947600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa60430-6264-4565-8ba6-8d602f3a9416 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:08.950644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:08.956767 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-cfa60430-6264-4565-8ba6-8d602f3a9416 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:54:08.960314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:08.968588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:08.969479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:54:08.969479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:54:08.969479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:54:08.969479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:54:08.969479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:54:08.969479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:54:08.969479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:08.969479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:08.969479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 316/635] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:08.971152 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa60430-6264-4565-8ba6-8d602f3a9416 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:09.044027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db3666-743b-454b-afc2-ae6efb21855b None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:09.084904 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ebdec-062a-4f51-9730-2399847c35c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:09.085990 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ebdec-062a-4f51-9730-2399847c35c4 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:09.086737 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ebdec-062a-4f51-9730-2399847c35c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:09.087222 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ebdec-062a-4f51-9730-2399847c35c4 None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:09.088249 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ebdec-062a-4f51-9730-2399847c35c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:09.088768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ebdec-062a-4f51-9730-2399847c35c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:09.090632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ebdec-062a-4f51-9730-2399847c35c4 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:09.096839 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa60430-6264-4565-8ba6-8d602f3a9416 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:09.106061 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 320/636] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:54:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:09.118851 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ebdec-062a-4f51-9730-2399847c35c4 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:09.134422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0def208-dcc6-445e-9078-0df4934a4f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:09.135037 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0def208-dcc6-445e-9078-0df4934a4f33 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:09.135296 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0def208-dcc6-445e-9078-0df4934a4f33 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:09.135561 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0def208-dcc6-445e-9078-0df4934a4f33 None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:09.136262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0def208-dcc6-445e-9078-0df4934a4f33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:09.136701 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0def208-dcc6-445e-9078-0df4934a4f33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:09.137963 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0def208-dcc6-445e-9078-0df4934a4f33 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:09.151652 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 317/637] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:54:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:09.157372 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0def208-dcc6-445e-9078-0df4934a4f33 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:09.230481 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:09.243715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:09.253058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ebdec-062a-4f51-9730-2399847c35c4 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:09.275591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0def208-dcc6-445e-9078-0df4934a4f33 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:09.295742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37666228-fc08-49b1-8b7a-8f9b03736112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:09.297280 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37666228-fc08-49b1-8b7a-8f9b03736112 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:09.297579 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37666228-fc08-49b1-8b7a-8f9b03736112 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:09.297854 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37666228-fc08-49b1-8b7a-8f9b03736112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:09.299026 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37666228-fc08-49b1-8b7a-8f9b03736112 None admin] RBAC: Adding query filter params (role.id=6282183e8c2b48b499413483605de6fc, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=1308dea6ef324bf388a0339ca911f36c) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:09.299822 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37666228-fc08-49b1-8b7a-8f9b03736112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:09.301642 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37666228-fc08-49b1-8b7a-8f9b03736112 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:09.310565 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 321/638] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:54:09 2022] GET /identity/v3/role_assignments?user.id=1308dea6ef324bf388a0339ca911f36c&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=6282183e8c2b48b499413483605de6fc => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:09.323578 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9cf70-c50d-4173-8769-088d9cb8ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:09.324259 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9cf70-c50d-4173-8769-088d9cb8ba84 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:09.324652 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9cf70-c50d-4173-8769-088d9cb8ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:09.324930 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9cf70-c50d-4173-8769-088d9cb8ba84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:09.325719 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9cf70-c50d-4173-8769-088d9cb8ba84 None admin] RBAC: Adding query filter params (role.id=6282183e8c2b48b499413483605de6fc, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=5c3e43e391e1470e90b21511b98b0d40) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:09.326037 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9cf70-c50d-4173-8769-088d9cb8ba84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:09.327610 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9cf70-c50d-4173-8769-088d9cb8ba84 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:09.334996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 318/639] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:54:09 2022] GET /identity/v3/role_assignments?user.id=5c3e43e391e1470e90b21511b98b0d40&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=6282183e8c2b48b499413483605de6fc => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:09.361954 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fcced-40bb-42b7-beb6-2f177596a9fb None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:09.362138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fcced-40bb-42b7-beb6-2f177596a9fb None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:09.362570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fcced-40bb-42b7-beb6-2f177596a9fb None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:09.364408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 322/640] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:09.370955 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d131d2-bed3-4080-b059-e1f29e3450f5 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:09.371290 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d131d2-bed3-4080-b059-e1f29e3450f5 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:09.371511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d131d2-bed3-4080-b059-e1f29e3450f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:09.392130 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-a4d131d2-bed3-4080-b059-e1f29e3450f5 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:09.393482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-a4d131d2-bed3-4080-b059-e1f29e3450f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:09.477928 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 319/641] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:54:09.803931 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fcced-40bb-42b7-beb6-2f177596a9fb None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:09.919407 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fcced-40bb-42b7-beb6-2f177596a9fb None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:09.960791 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c0d19-c47c-4a66-832f-b67017ebded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:09.961813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c0d19-c47c-4a66-832f-b67017ebded4 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:09.962326 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c0d19-c47c-4a66-832f-b67017ebded4 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:09.962810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c0d19-c47c-4a66-832f-b67017ebded4 None admin] PATH_INFO: `/v3/services/image` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:09.963603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c0d19-c47c-4a66-832f-b67017ebded4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:09.965213 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c0d19-c47c-4a66-832f-b67017ebded4 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-d09c0d19-c47c-4a66-832f-b67017ebded4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:09.977257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:09.978384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 14:54:09.979308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:09.982086 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 323/642] 10.222.0.52 () {56 vars in 1105 bytes} [Wed Aug 31 14:54:09 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:09.988394 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d131d2-bed3-4080-b059-e1f29e3450f5 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:10.052015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:10.101900 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d131d2-bed3-4080-b059-e1f29e3450f5 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:10.140175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115d41b-8b8d-47b3-bd22-b00c384ee093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:10.140791 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115d41b-8b8d-47b3-bd22-b00c384ee093 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:10.141068 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115d41b-8b8d-47b3-bd22-b00c384ee093 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:10.141339 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115d41b-8b8d-47b3-bd22-b00c384ee093 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:10.141961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115d41b-8b8d-47b3-bd22-b00c384ee093 None admin] RBAC: Adding query filter params (name=image) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:10.142259 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115d41b-8b8d-47b3-bd22-b00c384ee093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:10.143712 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115d41b-8b8d-47b3-bd22-b00c384ee093 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:10.148977 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 320/643] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:10.155158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c0d19-c47c-4a66-832f-b67017ebded4 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:10.184130 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:10.265634 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c16a1-3563-4370-bd73-38c4ad51223b None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:10.265972 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c16a1-3563-4370-bd73-38c4ad51223b None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:10.266098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c0d19-c47c-4a66-832f-b67017ebded4 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:10.266182 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c16a1-3563-4370-bd73-38c4ad51223b None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:10.267874 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 321/644] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:10.273962 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e5e82-8fb7-42bf-9619-83d66b3969c1 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:10.278481 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e5e82-8fb7-42bf-9619-83d66b3969c1 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:10.278977 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e5e82-8fb7-42bf-9619-83d66b3969c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:10.299052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-665e5e82-8fb7-42bf-9619-83d66b3969c1 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:10.300795 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-665e5e82-8fb7-42bf-9619-83d66b3969c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:10.302914 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ebb6c-6ef8-4167-a7a8-544c244bf407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:10.303513 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ebb6c-6ef8-4167-a7a8-544c244bf407 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:10.303946 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ebb6c-6ef8-4167-a7a8-544c244bf407 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:10.304224 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ebb6c-6ef8-4167-a7a8-544c244bf407 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:10.305436 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ebb6c-6ef8-4167-a7a8-544c244bf407 None admin] RBAC: Adding query filter params (type=image) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:10.305747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ebb6c-6ef8-4167-a7a8-544c244bf407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:10.307150 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ebb6c-6ef8-4167-a7a8-544c244bf407 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:10.313072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 324/645] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:10.385910 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 322/646] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:54:10.713207 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ebb6c-6ef8-4167-a7a8-544c244bf407 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:10.806830 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:10.822338 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ebb6c-6ef8-4167-a7a8-544c244bf407 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:10.860784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4c5e9-a9e8-4d3e-84b5-50b81333064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:10.861420 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4c5e9-a9e8-4d3e-84b5-50b81333064f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:10.861701 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4c5e9-a9e8-4d3e-84b5-50b81333064f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:10.861972 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4c5e9-a9e8-4d3e-84b5-50b81333064f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:10.873746 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4c5e9-a9e8-4d3e-84b5-50b81333064f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-7ad4c5e9-a9e8-4d3e-84b5-50b81333064f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:54:10.878570 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:10.879608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:10.880616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 325/647] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:54:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:10.887795 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e5e82-8fb7-42bf-9619-83d66b3969c1 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:10.942721 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:10.991588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e5e82-8fb7-42bf-9619-83d66b3969c1 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:11.027105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8c6ea-951b-490c-93ee-626ad0bfc641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:11.028187 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c6ea-951b-490c-93ee-626ad0bfc641 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:11.028187 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c6ea-951b-490c-93ee-626ad0bfc641 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:11.028388 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c6ea-951b-490c-93ee-626ad0bfc641 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:11.028931 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8c6ea-951b-490c-93ee-626ad0bfc641 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:11.029254 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8c6ea-951b-490c-93ee-626ad0bfc641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:11.030637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8c6ea-951b-490c-93ee-626ad0bfc641 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:11.040430 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 323/648] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:54:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:11.046403 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4c5e9-a9e8-4d3e-84b5-50b81333064f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:11.152997 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4c5e9-a9e8-4d3e-84b5-50b81333064f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:11.188174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451b739-3a6b-4dda-b2b8-ea054a220c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:11.189285 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451b739-3a6b-4dda-b2b8-ea054a220c7f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:11.189816 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451b739-3a6b-4dda-b2b8-ea054a220c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:11.190284 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451b739-3a6b-4dda-b2b8-ea054a220c7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:11.201697 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451b739-3a6b-4dda-b2b8-ea054a220c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:11.203474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451b739-3a6b-4dda-b2b8-ea054a220c7f None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:11.210465 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-c451b739-3a6b-4dda-b2b8-ea054a220c7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:11.219506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:11.220470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:11.221368 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:11.221368 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:11.221368 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:11.225320 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 326/649] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:11.227505 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8c6ea-951b-490c-93ee-626ad0bfc641 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:11.338777 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8c6ea-951b-490c-93ee-626ad0bfc641 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:11.349403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:11.374184 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d60e9-97b1-4d58-8e8d-6047a02e8412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:11.374827 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d60e9-97b1-4d58-8e8d-6047a02e8412 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:11.375104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d60e9-97b1-4d58-8e8d-6047a02e8412 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:11.375374 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d60e9-97b1-4d58-8e8d-6047a02e8412 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:11.376012 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d60e9-97b1-4d58-8e8d-6047a02e8412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:11.376309 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d60e9-97b1-4d58-8e8d-6047a02e8412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:11.377683 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d60e9-97b1-4d58-8e8d-6047a02e8412 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:11.389940 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 324/650] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:11.395543 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451b739-3a6b-4dda-b2b8-ea054a220c7f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:11.514977 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451b739-3a6b-4dda-b2b8-ea054a220c7f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:11.555370 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a8974-ed12-421f-b172-b75d30808721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:11.556134 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a8974-ed12-421f-b172-b75d30808721 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:11.556420 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a8974-ed12-421f-b172-b75d30808721 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:11.556692 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a8974-ed12-421f-b172-b75d30808721 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:11.565942 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a8974-ed12-421f-b172-b75d30808721 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:11.567560 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a8974-ed12-421f-b172-b75d30808721 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-a58a8974-ed12-421f-b172-b75d30808721 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:54:11.585414 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:11.586698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:11.587813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:11.587813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:11.587813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:54:11.587813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:54:11.587813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:54:11.587813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:54:11.587813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:54:11.587813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:54:11.587813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 14:54:11.587813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:11.590438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 327/651] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 31 14:54:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:11.593025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d60e9-97b1-4d58-8e8d-6047a02e8412 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:11.630864 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b2c11-a392-4b07-8550-65bcf4d370db None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:11.631148 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b2c11-a392-4b07-8550-65bcf4d370db None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:11.631428 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b2c11-a392-4b07-8550-65bcf4d370db None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:11.636609 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 328/652] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:54:11.638240 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649637-d61f-43b1-b3af-2fda7a11c041 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:11.638732 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649637-d61f-43b1-b3af-2fda7a11c041 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:11.639198 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649637-d61f-43b1-b3af-2fda7a11c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:11.658019 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-62649637-d61f-43b1-b3af-2fda7a11c041 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:11.659253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-62649637-d61f-43b1-b3af-2fda7a11c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:11.718416 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d60e9-97b1-4d58-8e8d-6047a02e8412 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:11.720210 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:11.738644 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 329/653] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:54:11.754886 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68016d46-d4ae-4a5f-999d-41ca515f4f73 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:11.755246 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68016d46-d4ae-4a5f-999d-41ca515f4f73 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:11.755592 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68016d46-d4ae-4a5f-999d-41ca515f4f73 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:11.757209 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 330/654] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:54:11.762792 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84b3b0-bda9-4ea5-a526-0a3a9bcea5a9 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:11.763138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84b3b0-bda9-4ea5-a526-0a3a9bcea5a9 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:11.763481 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84b3b0-bda9-4ea5-a526-0a3a9bcea5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:11.764994 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d49d8d-8203-4430-9c94-69c8c217c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:11.765852 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d49d8d-8203-4430-9c94-69c8c217c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:11.766338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d49d8d-8203-4430-9c94-69c8c217c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:11.766889 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d49d8d-8203-4430-9c94-69c8c217c6e0 None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:11.767896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d49d8d-8203-4430-9c94-69c8c217c6e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:11.768402 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d49d8d-8203-4430-9c94-69c8c217c6e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:11.770235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d49d8d-8203-4430-9c94-69c8c217c6e0 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:11.782198 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-aa84b3b0-bda9-4ea5-a526-0a3a9bcea5a9 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:11.783268 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-aa84b3b0-bda9-4ea5-a526-0a3a9bcea5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:11.797343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 325/655] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 31 14:54:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:11.799825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d49d8d-8203-4430-9c94-69c8c217c6e0 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:11.833088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:11.866617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 331/656] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:54:11.924471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d49d8d-8203-4430-9c94-69c8c217c6e0 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:11.962003 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb3a0c-199e-4310-834f-7d4eb8f8d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:11.963030 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb3a0c-199e-4310-834f-7d4eb8f8d264 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:11.963519 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb3a0c-199e-4310-834f-7d4eb8f8d264 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:11.963996 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb3a0c-199e-4310-834f-7d4eb8f8d264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:12.037833 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb3a0c-199e-4310-834f-7d4eb8f8d264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:12.040311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb3a0c-199e-4310-834f-7d4eb8f8d264 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:12.061502 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84b3b0-bda9-4ea5-a526-0a3a9bcea5a9 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:12.071102 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:12.154668 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 326/657] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:54:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 14:54:12.156723 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb3a0c-199e-4310-834f-7d4eb8f8d264 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:12.164455 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84b3b0-bda9-4ea5-a526-0a3a9bcea5a9 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:12.185869 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:12.205181 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e06aff-e2bd-4007-a600-7788e484cbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:12.205841 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e06aff-e2bd-4007-a600-7788e484cbe4 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:12.206121 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e06aff-e2bd-4007-a600-7788e484cbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:12.206424 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e06aff-e2bd-4007-a600-7788e484cbe4 None admin] PATH_INFO: `/v3/services/network` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:12.207007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e06aff-e2bd-4007-a600-7788e484cbe4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:12.208464 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e06aff-e2bd-4007-a600-7788e484cbe4 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-49e06aff-e2bd-4007-a600-7788e484cbe4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:12.219762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:12.221238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 14:54:12.222480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:12.226144 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 332/658] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:12 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:12.227115 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e06aff-e2bd-4007-a600-7788e484cbe4 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:12.274169 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb3a0c-199e-4310-834f-7d4eb8f8d264 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:12.300670 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:12.309473 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5410-616b-41ae-9855-1b10fb660f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:12.316314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5410-616b-41ae-9855-1b10fb660f4c None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:12.316314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5410-616b-41ae-9855-1b10fb660f4c None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:12.316314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5410-616b-41ae-9855-1b10fb660f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:12.321906 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa5410-616b-41ae-9855-1b10fb660f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:12.323354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa5410-616b-41ae-9855-1b10fb660f4c None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:12.334266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e06aff-e2bd-4007-a600-7788e484cbe4 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-a9fa5410-616b-41ae-9855-1b10fb660f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:12.338927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:12.339830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:12.340733 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:12.340733 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:12.340733 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:12.340733 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 327/659] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:12.341355 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5410-616b-41ae-9855-1b10fb660f4c None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:12.376647 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090461f0-3ded-42ad-8554-d4b7776b7e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:12.377271 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090461f0-3ded-42ad-8554-d4b7776b7e01 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:12.377549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090461f0-3ded-42ad-8554-d4b7776b7e01 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:12.377816 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090461f0-3ded-42ad-8554-d4b7776b7e01 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:12.378439 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090461f0-3ded-42ad-8554-d4b7776b7e01 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:12.379791 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090461f0-3ded-42ad-8554-d4b7776b7e01 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-090461f0-3ded-42ad-8554-d4b7776b7e01 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:12.389087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:12.390266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:12.391477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 333/660] 10.222.0.52 () {56 vars in 1129 bytes} [Wed Aug 31 14:54:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:12.395603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090461f0-3ded-42ad-8554-d4b7776b7e01 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:12.447279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:12.459724 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5410-616b-41ae-9855-1b10fb660f4c None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:12.498441 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e1937-c236-4dcb-8c73-dd4346af6d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:12.499074 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e1937-c236-4dcb-8c73-dd4346af6d3e None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:12.499361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e1937-c236-4dcb-8c73-dd4346af6d3e None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:12.499636 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e1937-c236-4dcb-8c73-dd4346af6d3e None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:12.500283 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e1937-c236-4dcb-8c73-dd4346af6d3e None admin] RBAC: Adding query filter params (name=network) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:12.500596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e1937-c236-4dcb-8c73-dd4346af6d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:12.502014 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e1937-c236-4dcb-8c73-dd4346af6d3e None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:12.505197 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090461f0-3ded-42ad-8554-d4b7776b7e01 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:12.510367 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 328/661] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:12.510367 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e1937-c236-4dcb-8c73-dd4346af6d3e None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:12.550656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496fb8a-00f9-46f8-aabd-00c15e9ee4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:12.551275 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496fb8a-00f9-46f8-aabd-00c15e9ee4fc None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:12.551682 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496fb8a-00f9-46f8-aabd-00c15e9ee4fc None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:12.551862 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496fb8a-00f9-46f8-aabd-00c15e9ee4fc None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:12.552890 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496fb8a-00f9-46f8-aabd-00c15e9ee4fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:12.553210 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496fb8a-00f9-46f8-aabd-00c15e9ee4fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:12.555186 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496fb8a-00f9-46f8-aabd-00c15e9ee4fc None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:12.559391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:12.569553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 334/662] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:12.570557 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496fb8a-00f9-46f8-aabd-00c15e9ee4fc None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:12.626178 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e1937-c236-4dcb-8c73-dd4346af6d3e None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:12.660574 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb09e3d-d52c-4458-ac99-8c8a938c95f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:12.661182 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb09e3d-d52c-4458-ac99-8c8a938c95f4 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:12.661467 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb09e3d-d52c-4458-ac99-8c8a938c95f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:12.661735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb09e3d-d52c-4458-ac99-8c8a938c95f4 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:12.662392 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb09e3d-d52c-4458-ac99-8c8a938c95f4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:12.662696 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb09e3d-d52c-4458-ac99-8c8a938c95f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:12.664609 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb09e3d-d52c-4458-ac99-8c8a938c95f4 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:12.669002 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 329/663] 10.222.0.52 () {56 vars in 1124 bytes} [Wed Aug 31 14:54:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:12.669780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb09e3d-d52c-4458-ac99-8c8a938c95f4 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:12.685073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496fb8a-00f9-46f8-aabd-00c15e9ee4fc None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:12.692082 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:12.721229 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca1ffd-03d0-4239-b0de-b517502ecd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:12.721770 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca1ffd-03d0-4239-b0de-b517502ecd42 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:12.722050 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca1ffd-03d0-4239-b0de-b517502ecd42 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:12.722433 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca1ffd-03d0-4239-b0de-b517502ecd42 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:12.723076 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca1ffd-03d0-4239-b0de-b517502ecd42 None admin] RBAC: Adding query filter params (type=network) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:12.723378 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca1ffd-03d0-4239-b0de-b517502ecd42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:12.724766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca1ffd-03d0-4239-b0de-b517502ecd42 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:12.738330 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 335/664] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:12.738330 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1d9fd-3c3f-43af-8050-ae1bf83d3573 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:12.738330 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1d9fd-3c3f-43af-8050-ae1bf83d3573 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:12.738330 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1d9fd-3c3f-43af-8050-ae1bf83d3573 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:12.738330 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 336/665] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:12.738330 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1d9fd-3c3f-43af-8050-ae1bf83d3573 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:12.777117 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb09e3d-d52c-4458-ac99-8c8a938c95f4 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:12.787135 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:12.817458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b9946-f955-4d41-b782-bc9283b88687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:12.818242 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b9946-f955-4d41-b782-bc9283b88687 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:12.818551 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b9946-f955-4d41-b782-bc9283b88687 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:12.818822 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b9946-f955-4d41-b782-bc9283b88687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:12.829701 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b9946-f955-4d41-b782-bc9283b88687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:12.831558 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b9946-f955-4d41-b782-bc9283b88687 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-580b9946-f955-4d41-b782-bc9283b88687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:54:12.846433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:12.847620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:12.848544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:54:12.848544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:54:12.848544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:54:12.848544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:54:12.848544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:54:12.848544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:54:12.848544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:12.848544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:12.853679 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 330/666] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:12.855092 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c338c8d-c797-46b0-bf1a-ac48bd4438c1 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:12.855535 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c338c8d-c797-46b0-bf1a-ac48bd4438c1 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:12.855680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c338c8d-c797-46b0-bf1a-ac48bd4438c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:12.868754 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1d9fd-3c3f-43af-8050-ae1bf83d3573 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:12.875329 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-5c338c8d-c797-46b0-bf1a-ac48bd4438c1 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:12.876591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-5c338c8d-c797-46b0-bf1a-ac48bd4438c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:12.911346 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2b55e-780a-4cf7-96a2-7a3d6734b6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:12.911953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2b55e-780a-4cf7-96a2-7a3d6734b6de None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:12.912233 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2b55e-780a-4cf7-96a2-7a3d6734b6de None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:12.912499 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2b55e-780a-4cf7-96a2-7a3d6734b6de None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:12.913124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2b55e-780a-4cf7-96a2-7a3d6734b6de None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:12.913423 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2b55e-780a-4cf7-96a2-7a3d6734b6de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:12.915525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2b55e-780a-4cf7-96a2-7a3d6734b6de None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:12.920854 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 337/667] 10.222.0.52 () {56 vars in 1124 bytes} [Wed Aug 31 14:54:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:12.921495 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2b55e-780a-4cf7-96a2-7a3d6734b6de None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:12.966762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:12.974787 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 331/668] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:54:13.047034 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2b55e-780a-4cf7-96a2-7a3d6734b6de None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:13.087519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c45c7-b73f-4e53-acf1-217e2b9a8421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:13.088238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c45c7-b73f-4e53-acf1-217e2b9a8421 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:13.088473 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c45c7-b73f-4e53-acf1-217e2b9a8421 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:13.088750 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c45c7-b73f-4e53-acf1-217e2b9a8421 None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:13.089465 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c45c7-b73f-4e53-acf1-217e2b9a8421 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:13.089768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c45c7-b73f-4e53-acf1-217e2b9a8421 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:13.091311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c45c7-b73f-4e53-acf1-217e2b9a8421 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:13.105202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 338/669] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:54:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:13.111521 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c338c8d-c797-46b0-bf1a-ac48bd4438c1 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:13.220963 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:13.229418 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c338c8d-c797-46b0-bf1a-ac48bd4438c1 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:13.262157 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3afabb-4790-4960-87c2-6ee8fc90edcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:13.262815 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3afabb-4790-4960-87c2-6ee8fc90edcf None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:13.263094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3afabb-4790-4960-87c2-6ee8fc90edcf None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:13.263363 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3afabb-4790-4960-87c2-6ee8fc90edcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:13.264135 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3afabb-4790-4960-87c2-6ee8fc90edcf None admin] RBAC: Adding query filter params (role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=98bb7c83115a45f1bdf9f48c6599db18) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:13.264489 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3afabb-4790-4960-87c2-6ee8fc90edcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:13.265906 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3afabb-4790-4960-87c2-6ee8fc90edcf None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:13.271990 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 332/670] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:54:13 2022] GET /identity/v3/role_assignments?user.id=98bb7c83115a45f1bdf9f48c6599db18&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:13.318517 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c45c7-b73f-4e53-acf1-217e2b9a8421 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:13.438978 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:13.442236 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c45c7-b73f-4e53-acf1-217e2b9a8421 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:13.480614 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f63e3-c880-4b24-9ee8-54d97d39af57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:13.481148 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f63e3-c880-4b24-9ee8-54d97d39af57 None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:13.481427 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f63e3-c880-4b24-9ee8-54d97d39af57 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:13.481701 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f63e3-c880-4b24-9ee8-54d97d39af57 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:13.482397 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f63e3-c880-4b24-9ee8-54d97d39af57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:13.484007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f63e3-c880-4b24-9ee8-54d97d39af57 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:13.562087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 339/671] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 31 14:54:13 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 14:54:14.966093 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f05c62-3f50-4aad-bee4-8a37b3cf35e2 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:14.966695 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f05c62-3f50-4aad-bee4-8a37b3cf35e2 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:14.966695 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f05c62-3f50-4aad-bee4-8a37b3cf35e2 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:14.968208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 333/672] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:14.973470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de06c8-ce2f-4b75-bfc5-cb91b3ab7d01 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:14.973878 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de06c8-ce2f-4b75-bfc5-cb91b3ab7d01 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:14.974024 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de06c8-ce2f-4b75-bfc5-cb91b3ab7d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:14.993933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-16de06c8-ce2f-4b75-bfc5-cb91b3ab7d01 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:14.995168 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-16de06c8-ce2f-4b75-bfc5-cb91b3ab7d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:15.080807 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 340/673] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:14 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:54:15.302618 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dfd73-1255-44e0-b1f2-29d04d11a6a6 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:15.303124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dfd73-1255-44e0-b1f2-29d04d11a6a6 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:15.303511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dfd73-1255-44e0-b1f2-29d04d11a6a6 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:15.305911 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 334/674] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:15.311337 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ddab-ccb6-43c4-9543-b76e535f2d51 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:15.311753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ddab-ccb6-43c4-9543-b76e535f2d51 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:15.312134 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ddab-ccb6-43c4-9543-b76e535f2d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:15.332390 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-d690ddab-ccb6-43c4-9543-b76e535f2d51 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:15.333638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-d690ddab-ccb6-43c4-9543-b76e535f2d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:15.410013 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dfd73-1255-44e0-b1f2-29d04d11a6a6 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:15.419904 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 341/675] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:15 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 14:54:15.513989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dfd73-1255-44e0-b1f2-29d04d11a6a6 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:15.532966 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f2720-b09d-46ea-8210-2d7ea1714192 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:15.533278 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f2720-b09d-46ea-8210-2d7ea1714192 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:15.533533 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f2720-b09d-46ea-8210-2d7ea1714192 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:15.535179 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 342/676] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:15.544134 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0aae7-0bb1-4bc2-85a1-fa88b35ca153 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:15.544418 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0aae7-0bb1-4bc2-85a1-fa88b35ca153 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:15.544696 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0aae7-0bb1-4bc2-85a1-fa88b35ca153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:15.552337 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce4218-d84f-4e81-9605-04f1be2e4f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:15.553274 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce4218-d84f-4e81-9605-04f1be2e4f76 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:15.553752 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce4218-d84f-4e81-9605-04f1be2e4f76 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:15.554220 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce4218-d84f-4e81-9605-04f1be2e4f76 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:15.555241 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce4218-d84f-4e81-9605-04f1be2e4f76 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:15.556832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce4218-d84f-4e81-9605-04f1be2e4f76 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:15.563910 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-b7f0aae7-0bb1-4bc2-85a1-fa88b35ca153 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:15.565142 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-b7f0aae7-0bb1-4bc2-85a1-fa88b35ca153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:15.568036 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:15.629693 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 335/677] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 31 14:54:15 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:54:15.642851 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 343/678] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:15 2022] POST /identity/v3/auth/tokens => generated 994 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 14:54:15.754378 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce4218-d84f-4e81-9605-04f1be2e4f76 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:15.782205 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:15.871016 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce4218-d84f-4e81-9605-04f1be2e4f76 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:15.906355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd16e7-87e4-4cfb-ac00-deef721b65c9 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:15.907068 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd16e7-87e4-4cfb-ac00-deef721b65c9 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:15.907678 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd16e7-87e4-4cfb-ac00-deef721b65c9 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:15.908885 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a2a02-814f-46fa-8279-3f2e7540c2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:15.909499 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a2a02-814f-46fa-8279-3f2e7540c2ed None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:15.909817 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a2a02-814f-46fa-8279-3f2e7540c2ed None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:15.910181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a2a02-814f-46fa-8279-3f2e7540c2ed None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:15.910404 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 344/679] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:54:15.914359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a2a02-814f-46fa-8279-3f2e7540c2ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:15.914359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a2a02-814f-46fa-8279-3f2e7540c2ed None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:15.916325 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3863c-5841-4c65-ab42-e4c1295060b8 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:15.916660 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3863c-5841-4c65-ab42-e4c1295060b8 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:15.917135 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3863c-5841-4c65-ab42-e4c1295060b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:15.935943 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-18e3863c-5841-4c65-ab42-e4c1295060b8 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:15.937242 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-18e3863c-5841-4c65-ab42-e4c1295060b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:15.979440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 336/680] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 31 14:54:15 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:54:15.989389 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a2a02-814f-46fa-8279-3f2e7540c2ed None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:16.025928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 345/681] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:15 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 14:54:16.096080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:16.118361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a2a02-814f-46fa-8279-3f2e7540c2ed None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:16.158580 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400ded8-b774-430a-9be3-56f21dea8fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:16.159237 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400ded8-b774-430a-9be3-56f21dea8fa7 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:16.159518 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400ded8-b774-430a-9be3-56f21dea8fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:16.159791 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400ded8-b774-430a-9be3-56f21dea8fa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:16.172275 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400ded8-b774-430a-9be3-56f21dea8fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-c400ded8-b774-430a-9be3-56f21dea8fa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:54:16.177144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:16.178088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:16.178980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 337/682] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:16.185371 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3863c-5841-4c65-ab42-e4c1295060b8 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:16.262784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:16.303208 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3863c-5841-4c65-ab42-e4c1295060b8 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:16.339548 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc5b41-fa8d-43ee-9392-120fafd24c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:16.340166 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc5b41-fa8d-43ee-9392-120fafd24c97 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:16.340444 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc5b41-fa8d-43ee-9392-120fafd24c97 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:16.340715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc5b41-fa8d-43ee-9392-120fafd24c97 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:16.341384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc5b41-fa8d-43ee-9392-120fafd24c97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:16.341687 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc5b41-fa8d-43ee-9392-120fafd24c97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:16.343090 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc5b41-fa8d-43ee-9392-120fafd24c97 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:16.357178 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 346/683] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:54:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:16.358809 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400ded8-b774-430a-9be3-56f21dea8fa7 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:16.379185 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc5b41-fa8d-43ee-9392-120fafd24c97 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:16.475909 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400ded8-b774-430a-9be3-56f21dea8fa7 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:16.505207 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc5b41-fa8d-43ee-9392-120fafd24c97 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:16.514280 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5304263-cd63-427c-be83-115d2f7710e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:16.515215 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5304263-cd63-427c-be83-115d2f7710e3 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:16.515777 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5304263-cd63-427c-be83-115d2f7710e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:16.516246 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5304263-cd63-427c-be83-115d2f7710e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:16.528856 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:16.529368 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5304263-cd63-427c-be83-115d2f7710e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:16.531835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5304263-cd63-427c-be83-115d2f7710e3 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:16.533768 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:16.540365 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae56e99-6a1b-4753-97db-af86bc909aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:16.540718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae56e99-6a1b-4753-97db-af86bc909aa2 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:16.541054 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae56e99-6a1b-4753-97db-af86bc909aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:16.541407 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae56e99-6a1b-4753-97db-af86bc909aa2 None admin] PATH_INFO: `/v3/services/image` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:16.541995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae56e99-6a1b-4753-97db-af86bc909aa2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:16.543386 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae56e99-6a1b-4753-97db-af86bc909aa2 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-f5304263-cd63-427c-be83-115d2f7710e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:16.549754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:16.550970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:16.551861 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:16.551861 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:16.551861 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-2ae56e99-6a1b-4753-97db-af86bc909aa2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:16.552438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:16.553354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:16.554188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 347/684] 10.222.0.52 () {56 vars in 1105 bytes} [Wed Aug 31 14:54:16 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:16.560595 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 338/685] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:16.561148 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae56e99-6a1b-4753-97db-af86bc909aa2 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:16.562404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5304263-cd63-427c-be83-115d2f7710e3 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:16.687086 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae56e99-6a1b-4753-97db-af86bc909aa2 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:16.725980 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9abc9-cac7-4020-be78-2c5f8d8c48ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:16.727452 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9abc9-cac7-4020-be78-2c5f8d8c48ed None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:16.727880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9abc9-cac7-4020-be78-2c5f8d8c48ed None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:16.728295 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9abc9-cac7-4020-be78-2c5f8d8c48ed None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:16.729094 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9abc9-cac7-4020-be78-2c5f8d8c48ed None admin] RBAC: Adding query filter params (name=image) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:16.729544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9abc9-cac7-4020-be78-2c5f8d8c48ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:16.731174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9abc9-cac7-4020-be78-2c5f8d8c48ed None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:16.738360 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 348/686] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:16.744597 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9abc9-cac7-4020-be78-2c5f8d8c48ed None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:16.805278 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:16.842529 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5304263-cd63-427c-be83-115d2f7710e3 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:16.870912 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9abc9-cac7-4020-be78-2c5f8d8c48ed None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:16.888563 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323ea3a-8656-4ccf-8dfe-feb78996e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:16.889173 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323ea3a-8656-4ccf-8dfe-feb78996e761 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:16.889450 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323ea3a-8656-4ccf-8dfe-feb78996e761 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:16.889716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323ea3a-8656-4ccf-8dfe-feb78996e761 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:16.890619 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323ea3a-8656-4ccf-8dfe-feb78996e761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:16.890926 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323ea3a-8656-4ccf-8dfe-feb78996e761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:16.892662 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323ea3a-8656-4ccf-8dfe-feb78996e761 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:16.907529 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 339/687] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:16.912826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323ea3a-8656-4ccf-8dfe-feb78996e761 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:16.917592 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cfbe4-6f14-4f3c-820d-0d37f62ec684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:16.918206 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cfbe4-6f14-4f3c-820d-0d37f62ec684 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:16.918512 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cfbe4-6f14-4f3c-820d-0d37f62ec684 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:16.918783 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cfbe4-6f14-4f3c-820d-0d37f62ec684 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:16.919417 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cfbe4-6f14-4f3c-820d-0d37f62ec684 None admin] RBAC: Adding query filter params (type=image) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:16.919725 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cfbe4-6f14-4f3c-820d-0d37f62ec684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:16.921091 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cfbe4-6f14-4f3c-820d-0d37f62ec684 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:16.926426 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 349/688] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:16.934407 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cfbe4-6f14-4f3c-820d-0d37f62ec684 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:16.985338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:17.040254 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323ea3a-8656-4ccf-8dfe-feb78996e761 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:17.078954 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76ae82-590e-4169-aad7-be736a1af821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:17.079594 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76ae82-590e-4169-aad7-be736a1af821 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:17.079869 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76ae82-590e-4169-aad7-be736a1af821 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:17.080135 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76ae82-590e-4169-aad7-be736a1af821 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:17.088939 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76ae82-590e-4169-aad7-be736a1af821 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:17.090403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76ae82-590e-4169-aad7-be736a1af821 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-be76ae82-590e-4169-aad7-be736a1af821 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:54:17.103019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:17.104235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:17.105166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:17.105166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:17.105166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:54:17.105166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:54:17.105166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:54:17.105166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:54:17.105166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:54:17.105166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:54:17.105166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 14:54:17.105166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:17.105166 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 340/689] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 31 14:54:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:17.110008 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76ae82-590e-4169-aad7-be736a1af821 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:17.179111 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cfbe4-6f14-4f3c-820d-0d37f62ec684 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:17.200462 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:17.219635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01b148-0d99-49a7-af57-53930a1f422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:17.220486 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01b148-0d99-49a7-af57-53930a1f422c None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:17.220988 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01b148-0d99-49a7-af57-53930a1f422c None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:17.221458 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01b148-0d99-49a7-af57-53930a1f422c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:17.222508 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01b148-0d99-49a7-af57-53930a1f422c None admin] RBAC: Adding query filter params (interface=public, service_id=ec8cc3db24fc4ceb9e4483f2c3086e26, region_id=RegionOne) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:17.223033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01b148-0d99-49a7-af57-53930a1f422c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:17.224555 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01b148-0d99-49a7-af57-53930a1f422c None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:17.238975 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 350/690] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 31 14:54:16 2022] GET /identity/v3/endpoints?service_id=ec8cc3db24fc4ceb9e4483f2c3086e26&interface=public®ion_id=RegionOne => generated 194 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:17.240272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01b148-0d99-49a7-af57-53930a1f422c None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:17.253463 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76ae82-590e-4169-aad7-be736a1af821 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:17.277461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:17.307341 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e6a13-9092-44c6-acc0-a6b20a5ae742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:17.308067 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e6a13-9092-44c6-acc0-a6b20a5ae742 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:17.308424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e6a13-9092-44c6-acc0-a6b20a5ae742 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:17.308766 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e6a13-9092-44c6-acc0-a6b20a5ae742 None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:17.310077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e6a13-9092-44c6-acc0-a6b20a5ae742 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:17.310424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e6a13-9092-44c6-acc0-a6b20a5ae742 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:17.312008 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e6a13-9092-44c6-acc0-a6b20a5ae742 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:17.335191 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 341/691] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 31 14:54:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:17.340738 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e6a13-9092-44c6-acc0-a6b20a5ae742 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:17.361324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01b148-0d99-49a7-af57-53930a1f422c None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:17.401639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332665-1a2b-4c76-af16-6ca9ab82be72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:17.402593 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332665-1a2b-4c76-af16-6ca9ab82be72 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:17.403055 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332665-1a2b-4c76-af16-6ca9ab82be72 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:17.403567 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332665-1a2b-4c76-af16-6ca9ab82be72 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:17.404508 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd332665-1a2b-4c76-af16-6ca9ab82be72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:17.406189 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd332665-1a2b-4c76-af16-6ca9ab82be72 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:17.418624 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 351/692] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 31 14:54:17 2022] GET /identity/v3/services => generated 1002 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 14:54:17.462261 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e6a13-9092-44c6-acc0-a6b20a5ae742 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:17.503564 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d88afb-b3be-4303-98a9-87f13e92e29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:17.504554 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d88afb-b3be-4303-98a9-87f13e92e29a None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:17.505038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d88afb-b3be-4303-98a9-87f13e92e29a None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:17.505511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d88afb-b3be-4303-98a9-87f13e92e29a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:17.518092 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d88afb-b3be-4303-98a9-87f13e92e29a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:17.520005 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d88afb-b3be-4303-98a9-87f13e92e29a None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-57d88afb-b3be-4303-98a9-87f13e92e29a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:17.537343 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:17.538404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:17.540202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:17.540202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:17.540202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:17.542688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 342/693] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:17.550427 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332665-1a2b-4c76-af16-6ca9ab82be72 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:17.606615 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:17.667140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332665-1a2b-4c76-af16-6ca9ab82be72 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:17.701841 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466bb0f-99df-4e5c-bff7-b61efef65386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:17.702487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466bb0f-99df-4e5c-bff7-b61efef65386 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:17.702766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466bb0f-99df-4e5c-bff7-b61efef65386 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:17.703036 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466bb0f-99df-4e5c-bff7-b61efef65386 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:17.703681 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466bb0f-99df-4e5c-bff7-b61efef65386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:17.703985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466bb0f-99df-4e5c-bff7-b61efef65386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:17.705329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466bb0f-99df-4e5c-bff7-b61efef65386 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:17.718470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 352/694] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:17.723866 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d88afb-b3be-4303-98a9-87f13e92e29a None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:17.752981 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:17.844410 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d88afb-b3be-4303-98a9-87f13e92e29a None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:17.881270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d4161-ed8f-48bf-87a8-20d578cf29f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:17.881902 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d4161-ed8f-48bf-87a8-20d578cf29f1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:17.882182 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d4161-ed8f-48bf-87a8-20d578cf29f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:17.882557 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d4161-ed8f-48bf-87a8-20d578cf29f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:17.890493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d4161-ed8f-48bf-87a8-20d578cf29f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:17.891943 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d4161-ed8f-48bf-87a8-20d578cf29f1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-d74d4161-ed8f-48bf-87a8-20d578cf29f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:54:17.903764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:17.904726 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:17.906080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:54:17.906080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:54:17.906080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:54:17.906080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:54:17.906080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:54:17.906080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:54:17.906080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:17.906080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:17.906080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 343/695] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:17.915416 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466bb0f-99df-4e5c-bff7-b61efef65386 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:17.954564 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b2dd2-88e5-4324-b12f-c45ab9da5b4f None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:17.954878 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b2dd2-88e5-4324-b12f-c45ab9da5b4f None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:17.955119 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b2dd2-88e5-4324-b12f-c45ab9da5b4f None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:17.956765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 344/696] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:17.962205 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c2c4-5045-475b-943f-68c38efc40b6 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:17.962526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c2c4-5045-475b-943f-68c38efc40b6 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:17.962796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c2c4-5045-475b-943f-68c38efc40b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:17.983271 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-21f9c2c4-5045-475b-943f-68c38efc40b6 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:17.984478 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-21f9c2c4-5045-475b-943f-68c38efc40b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:18.038752 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466bb0f-99df-4e5c-bff7-b61efef65386 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:18.042107 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:18.057964 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 345/697] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:17 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 14:54:18.077229 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1366e-3f59-488e-841d-ce8d4219a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:18.078084 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1366e-3f59-488e-841d-ce8d4219a0ec None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:18.078543 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1366e-3f59-488e-841d-ce8d4219a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:18.079206 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1366e-3f59-488e-841d-ce8d4219a0ec None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:18.080545 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1366e-3f59-488e-841d-ce8d4219a0ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:18.081000 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1366e-3f59-488e-841d-ce8d4219a0ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:18.082586 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1366e-3f59-488e-841d-ce8d4219a0ec None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:18.096218 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 353/698] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:54:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:18.102102 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c2c4-5045-475b-943f-68c38efc40b6 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:18.123291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:18.213413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c2c4-5045-475b-943f-68c38efc40b6 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:18.248959 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a2412-59ff-4ab6-bfe7-258f38fc3789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:18.249848 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a2412-59ff-4ab6-bfe7-258f38fc3789 None admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:18.250280 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a2412-59ff-4ab6-bfe7-258f38fc3789 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:18.250754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a2412-59ff-4ab6-bfe7-258f38fc3789 None admin] PATH_INFO: `/v3/projects/cac45966110b47f28339c78e693b3793/users/98bb7c83115a45f1bdf9f48c6599db18/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:18.252831 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a2412-59ff-4ab6-bfe7-258f38fc3789 None admin] RBAC: Authorizing `identity:create_grant(project_id=cac45966110b47f28339c78e693b3793, user_id=98bb7c83115a45f1bdf9f48c6599db18, role_id=7fe1d0d9f098408c9dc7ed9fca08a4a4)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:18.254453 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a2412-59ff-4ab6-bfe7-258f38fc3789 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:18.316103 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 346/699] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:54:18 2022] PUT /identity/v3/projects/cac45966110b47f28339c78e693b3793/users/98bb7c83115a45f1bdf9f48c6599db18/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:54:18.391964 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1366e-3f59-488e-841d-ce8d4219a0ec None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:18.459242 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e157e9a-6c0d-4331-adfd-e0426976e38d None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:18.459885 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e157e9a-6c0d-4331-adfd-e0426976e38d None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:18.460362 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e157e9a-6c0d-4331-adfd-e0426976e38d None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:18.462352 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 347/700] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:18.469214 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb481-4042-4504-97d3-edbcefd6a4cd None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:18.469919 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb481-4042-4504-97d3-edbcefd6a4cd None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:18.470473 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb481-4042-4504-97d3-edbcefd6a4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:18.490498 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-668fb481-4042-4504-97d3-edbcefd6a4cd None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:18.492591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-668fb481-4042-4504-97d3-edbcefd6a4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:18.517763 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1366e-3f59-488e-841d-ce8d4219a0ec None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:18.559196 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157fe32-243c-4576-b1d6-63325b10460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:18.559830 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157fe32-243c-4576-b1d6-63325b10460d None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:18.560109 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157fe32-243c-4576-b1d6-63325b10460d None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:18.560379 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157fe32-243c-4576-b1d6-63325b10460d None admin] PATH_INFO: `/v3/services/network` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:18.560962 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157fe32-243c-4576-b1d6-63325b10460d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:18.562337 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157fe32-243c-4576-b1d6-63325b10460d None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-c157fe32-243c-4576-b1d6-63325b10460d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:18.572250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:18.573485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 14:54:18.574509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:18.576963 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 354/701] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:18 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:18.582889 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157fe32-243c-4576-b1d6-63325b10460d None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:18.584445 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 348/702] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 14:54:18.618065 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:18.695890 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157fe32-243c-4576-b1d6-63325b10460d None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:18.731021 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410aab-beb3-408d-8fa7-04173bdb3ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:18.732006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410aab-beb3-408d-8fa7-04173bdb3ee2 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:18.732447 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410aab-beb3-408d-8fa7-04173bdb3ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:18.733185 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410aab-beb3-408d-8fa7-04173bdb3ee2 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:18.733968 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83410aab-beb3-408d-8fa7-04173bdb3ee2 None admin] RBAC: Adding query filter params (name=network) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:18.734451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83410aab-beb3-408d-8fa7-04173bdb3ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:18.735965 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83410aab-beb3-408d-8fa7-04173bdb3ee2 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:18.741154 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 355/703] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:18.747626 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb481-4042-4504-97d3-edbcefd6a4cd None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:18.770604 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:18.863892 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb481-4042-4504-97d3-edbcefd6a4cd None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:18.899409 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e953adb-4318-458a-b580-b8f64a524eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:18.900302 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e953adb-4318-458a-b580-b8f64a524eb0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:18.900757 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e953adb-4318-458a-b580-b8f64a524eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:18.901202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e953adb-4318-458a-b580-b8f64a524eb0 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:18.902000 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e953adb-4318-458a-b580-b8f64a524eb0 None admin] RBAC: Adding query filter params (type=network) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:18.902572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e953adb-4318-458a-b580-b8f64a524eb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:18.904092 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e953adb-4318-458a-b580-b8f64a524eb0 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:18.910692 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 349/704] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:18.917486 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410aab-beb3-408d-8fa7-04173bdb3ee2 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:18.924506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e953adb-4318-458a-b580-b8f64a524eb0 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:19.009499 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:19.032471 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:19.042138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410aab-beb3-408d-8fa7-04173bdb3ee2 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:19.053548 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e953adb-4318-458a-b580-b8f64a524eb0 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:19.089336 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07062d-317f-42b4-908d-9c3cb348cfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:19.091481 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07062d-317f-42b4-908d-9c3cb348cfd3 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:19.094400 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07062d-317f-42b4-908d-9c3cb348cfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:19.094501 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dba23-d639-4163-8e8f-d2899e05d0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:19.094933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07062d-317f-42b4-908d-9c3cb348cfd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:19.095019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dba23-d639-4163-8e8f-d2899e05d0c1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:19.095101 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07062d-317f-42b4-908d-9c3cb348cfd3 None admin] RBAC: Adding query filter params (interface=public, service_id=d5475dfe07e64479a9e90073d6ba4236, region_id=RegionOne) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:19.095184 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dba23-d639-4163-8e8f-d2899e05d0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:19.095253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07062d-317f-42b4-908d-9c3cb348cfd3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:19.095318 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dba23-d639-4163-8e8f-d2899e05d0c1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:19.095318 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dba23-d639-4163-8e8f-d2899e05d0c1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:19.095318 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dba23-d639-4163-8e8f-d2899e05d0c1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:19.095903 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07062d-317f-42b4-908d-9c3cb348cfd3 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:19.103036 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 356/705] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 31 14:54:18 2022] GET /identity/v3/endpoints?service_id=d5475dfe07e64479a9e90073d6ba4236&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-0b3dba23-d639-4163-8e8f-d2899e05d0c1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:19.108239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:19.109293 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 14:54:19.110185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:19.110959 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07062d-317f-42b4-908d-9c3cb348cfd3 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:19.113043 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 350/706] 10.222.0.52 () {56 vars in 1129 bytes} [Wed Aug 31 14:54:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:19.122332 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dba23-d639-4163-8e8f-d2899e05d0c1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:19.232412 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dba23-d639-4163-8e8f-d2899e05d0c1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:19.242513 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07062d-317f-42b4-908d-9c3cb348cfd3 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:19.265916 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:19.272007 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88393c44-7d5c-4e76-a567-b90976a437c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:19.272897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393c44-7d5c-4e76-a567-b90976a437c9 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:19.277577 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393c44-7d5c-4e76-a567-b90976a437c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:19.277577 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393c44-7d5c-4e76-a567-b90976a437c9 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:19.277577 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88393c44-7d5c-4e76-a567-b90976a437c9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:19.277577 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88393c44-7d5c-4e76-a567-b90976a437c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:19.277577 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88393c44-7d5c-4e76-a567-b90976a437c9 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:19.286351 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4b484-dba6-4a11-b335-855c581371f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:19.286527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 351/707] 10.222.0.52 () {56 vars in 1124 bytes} [Wed Aug 31 14:54:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:19.287101 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4b484-dba6-4a11-b335-855c581371f6 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:19.287388 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4b484-dba6-4a11-b335-855c581371f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:19.287656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4b484-dba6-4a11-b335-855c581371f6 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:19.288236 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88393c44-7d5c-4e76-a567-b90976a437c9 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:19.288356 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4b484-dba6-4a11-b335-855c581371f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:19.290507 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4b484-dba6-4a11-b335-855c581371f6 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:19.298385 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 357/708] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 31 14:54:19 2022] GET /identity/v3/services => generated 1002 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 14:54:19.417868 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88393c44-7d5c-4e76-a567-b90976a437c9 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:19.455916 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c037c-ed7b-4434-aa2d-b8a68dab627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:19.456537 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c037c-ed7b-4434-aa2d-b8a68dab627b None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:19.456812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c037c-ed7b-4434-aa2d-b8a68dab627b None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:19.457078 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c037c-ed7b-4434-aa2d-b8a68dab627b None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:19.457712 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c037c-ed7b-4434-aa2d-b8a68dab627b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:19.458008 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c037c-ed7b-4434-aa2d-b8a68dab627b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:19.459425 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c037c-ed7b-4434-aa2d-b8a68dab627b None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:19.466120 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 352/709] 10.222.0.52 () {56 vars in 1124 bytes} [Wed Aug 31 14:54:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:19.472304 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4b484-dba6-4a11-b335-855c581371f6 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:19.498461 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:19.587689 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4b484-dba6-4a11-b335-855c581371f6 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:19.627537 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d626df2-bd1f-4f8c-9354-a42121f082a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:19.628199 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d626df2-bd1f-4f8c-9354-a42121f082a2 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:19.628480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d626df2-bd1f-4f8c-9354-a42121f082a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:19.628751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d626df2-bd1f-4f8c-9354-a42121f082a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:19.629466 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d626df2-bd1f-4f8c-9354-a42121f082a2 None admin] RBAC: Adding query filter params (interface=public, service_id=d609b12de34d4f3194755769b2a8f615, region_id=RegionOne) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:19.629771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d626df2-bd1f-4f8c-9354-a42121f082a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:19.631181 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d626df2-bd1f-4f8c-9354-a42121f082a2 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:19.637542 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 358/710] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 31 14:54:19 2022] GET /identity/v3/endpoints?service_id=d609b12de34d4f3194755769b2a8f615&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:19.647927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c037c-ed7b-4434-aa2d-b8a68dab627b None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:19.712315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:19.755305 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c037c-ed7b-4434-aa2d-b8a68dab627b None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:19.779742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092db38f-1af5-4c19-9edb-8f0766a6edcc None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:19.780353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092db38f-1af5-4c19-9edb-8f0766a6edcc None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:19.780833 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092db38f-1af5-4c19-9edb-8f0766a6edcc None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:19.782638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 359/711] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:19.787670 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdda8e8-86bf-4d3e-b328-760569875f7c None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:19.788234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdda8e8-86bf-4d3e-b328-760569875f7c None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:19.789265 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdda8e8-86bf-4d3e-b328-760569875f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:19.791082 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec273e9e-9d2d-4475-ba51-8714076b3290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:19.791681 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec273e9e-9d2d-4475-ba51-8714076b3290 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:19.794898 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec273e9e-9d2d-4475-ba51-8714076b3290 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:19.794898 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec273e9e-9d2d-4475-ba51-8714076b3290 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:19.794898 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec273e9e-9d2d-4475-ba51-8714076b3290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:19.794898 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec273e9e-9d2d-4475-ba51-8714076b3290 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:19.806627 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 353/712] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 31 14:54:19 2022] GET /identity/v3/services => generated 1002 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 14:54:19.811464 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-efdda8e8-86bf-4d3e-b328-760569875f7c None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:19.812982 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-efdda8e8-86bf-4d3e-b328-760569875f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:19.902325 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 360/713] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:19 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 14:54:20.235715 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec273e9e-9d2d-4475-ba51-8714076b3290 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:20.346248 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec273e9e-9d2d-4475-ba51-8714076b3290 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:20.372225 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:20.383158 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc17d1-5248-4afa-9e64-ba5c88b8580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:20.383785 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc17d1-5248-4afa-9e64-ba5c88b8580b None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:20.384067 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc17d1-5248-4afa-9e64-ba5c88b8580b None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:20.384342 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc17d1-5248-4afa-9e64-ba5c88b8580b None admin] PATH_INFO: `/v3/services/image` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:20.384991 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc17d1-5248-4afa-9e64-ba5c88b8580b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:20.386396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc17d1-5248-4afa-9e64-ba5c88b8580b None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-e5bc17d1-5248-4afa-9e64-ba5c88b8580b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:20.395527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:20.396506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:20.397338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 354/714] 10.222.0.52 () {56 vars in 1105 bytes} [Wed Aug 31 14:54:20 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:20.404854 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdda8e8-86bf-4d3e-b328-760569875f7c None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:20.427691 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:20.526014 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdda8e8-86bf-4d3e-b328-760569875f7c None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:20.564120 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e7aed-e164-45c1-abee-78cc529c69be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:20.565165 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7aed-e164-45c1-abee-78cc529c69be None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:20.565630 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7aed-e164-45c1-abee-78cc529c69be None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:20.566054 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7aed-e164-45c1-abee-78cc529c69be None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:20.566899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e7aed-e164-45c1-abee-78cc529c69be None admin] RBAC: Adding query filter params (name=image) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:20.567380 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e7aed-e164-45c1-abee-78cc529c69be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:20.568946 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e7aed-e164-45c1-abee-78cc529c69be None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:20.575447 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 361/715] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:20.583406 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc17d1-5248-4afa-9e64-ba5c88b8580b None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:20.653776 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141ec3c-9708-46c6-b53f-7b1c2bda4c5e None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:20.654105 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141ec3c-9708-46c6-b53f-7b1c2bda4c5e None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:20.654376 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141ec3c-9708-46c6-b53f-7b1c2bda4c5e None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:20.655943 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 362/716] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:20.660653 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5900f-0a32-478b-a002-f6ca2bd6cb02 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:20.660934 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5900f-0a32-478b-a002-f6ca2bd6cb02 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:20.661211 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5900f-0a32-478b-a002-f6ca2bd6cb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:20.680418 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-43d5900f-0a32-478b-a002-f6ca2bd6cb02 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:20.681623 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-43d5900f-0a32-478b-a002-f6ca2bd6cb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:20.695244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc17d1-5248-4afa-9e64-ba5c88b8580b None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:20.733276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484484c5-2814-4016-adb8-6e64aa51473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:20.733879 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484484c5-2814-4016-adb8-6e64aa51473e None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:20.734214 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484484c5-2814-4016-adb8-6e64aa51473e None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:20.734516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484484c5-2814-4016-adb8-6e64aa51473e None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:20.735200 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484484c5-2814-4016-adb8-6e64aa51473e None admin] RBAC: Adding query filter params (type=image) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:20.735506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484484c5-2814-4016-adb8-6e64aa51473e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:20.736875 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484484c5-2814-4016-adb8-6e64aa51473e None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:20.743242 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 355/717] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:20.748944 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484484c5-2814-4016-adb8-6e64aa51473e None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:20.770681 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 363/718] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:20 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 14:54:20.811958 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:20.873830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484484c5-2814-4016-adb8-6e64aa51473e None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:20.915034 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2ad8c-7973-4f9c-a4de-9249a25db5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:20.915998 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2ad8c-7973-4f9c-a4de-9249a25db5bd None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:20.916479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2ad8c-7973-4f9c-a4de-9249a25db5bd None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:20.916953 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2ad8c-7973-4f9c-a4de-9249a25db5bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:20.917840 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2ad8c-7973-4f9c-a4de-9249a25db5bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:20.919440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2ad8c-7973-4f9c-a4de-9249a25db5bd None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:21.030452 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 356/719] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 31 14:54:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 14:54:21.145045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5900f-0a32-478b-a002-f6ca2bd6cb02 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:21.157183 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:21.255271 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5900f-0a32-478b-a002-f6ca2bd6cb02 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:21.298979 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e60294-52c0-4c48-b814-cbd4824dec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:21.299616 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e60294-52c0-4c48-b814-cbd4824dec68 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:21.299898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e60294-52c0-4c48-b814-cbd4824dec68 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:21.300169 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e60294-52c0-4c48-b814-cbd4824dec68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:21.312011 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e60294-52c0-4c48-b814-cbd4824dec68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-37e60294-52c0-4c48-b814-cbd4824dec68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:54:21.316850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:21.317764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:21.319145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 364/720] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:54:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:21.323864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2ad8c-7973-4f9c-a4de-9249a25db5bd None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:21.432884 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2ad8c-7973-4f9c-a4de-9249a25db5bd None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:21.442545 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:21.469462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05313e82-1e1a-4156-b84d-ef11724b0858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:21.470121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05313e82-1e1a-4156-b84d-ef11724b0858 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:21.470433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05313e82-1e1a-4156-b84d-ef11724b0858 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:21.470701 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05313e82-1e1a-4156-b84d-ef11724b0858 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:21.471358 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05313e82-1e1a-4156-b84d-ef11724b0858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:21.471657 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05313e82-1e1a-4156-b84d-ef11724b0858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:21.473012 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05313e82-1e1a-4156-b84d-ef11724b0858 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:21.483936 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 357/721] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:54:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:21.489397 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e60294-52c0-4c48-b814-cbd4824dec68 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:21.558092 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:21.605100 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e60294-52c0-4c48-b814-cbd4824dec68 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:21.643913 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f62aa6-a917-4dff-abcd-8d7b54607975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:21.644598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f62aa6-a917-4dff-abcd-8d7b54607975 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:21.644880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f62aa6-a917-4dff-abcd-8d7b54607975 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:21.645165 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f62aa6-a917-4dff-abcd-8d7b54607975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:21.657009 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f62aa6-a917-4dff-abcd-8d7b54607975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:21.658486 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f62aa6-a917-4dff-abcd-8d7b54607975 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-c6f62aa6-a917-4dff-abcd-8d7b54607975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:21.674993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:21.676033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:21.677575 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:21.677575 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:21.677575 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:21.677575 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 365/722] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:21.682047 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05313e82-1e1a-4156-b84d-ef11724b0858 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:21.763953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06124089-c806-40f1-a6f0-84b57b84187d None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:21.764180 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06124089-c806-40f1-a6f0-84b57b84187d None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:21.764492 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06124089-c806-40f1-a6f0-84b57b84187d None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:21.765969 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 366/723] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:21.770806 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6645e-be66-4e76-9fa3-df999cdec34b None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:21.771088 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6645e-be66-4e76-9fa3-df999cdec34b None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:21.771361 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6645e-be66-4e76-9fa3-df999cdec34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:21.791247 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-ece6645e-be66-4e76-9fa3-df999cdec34b None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:21.792435 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-ece6645e-be66-4e76-9fa3-df999cdec34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:21.857418 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05313e82-1e1a-4156-b84d-ef11724b0858 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:21.886575 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 367/724] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:21 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 14:54:21.919658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bf487-4dfe-4228-b7ec-b18988a8ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:21.920702 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf487-4dfe-4228-b7ec-b18988a8ebc1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:21.921298 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf487-4dfe-4228-b7ec-b18988a8ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:21.921770 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf487-4dfe-4228-b7ec-b18988a8ebc1 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:21.922964 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bf487-4dfe-4228-b7ec-b18988a8ebc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:21.923491 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bf487-4dfe-4228-b7ec-b18988a8ebc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:21.926168 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bf487-4dfe-4228-b7ec-b18988a8ebc1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:21.950574 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 358/725] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:21.956345 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6645e-be66-4e76-9fa3-df999cdec34b None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:22.004725 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:22.058709 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6645e-be66-4e76-9fa3-df999cdec34b None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:22.095211 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81752ece-2c49-4dc7-8ef4-4a4913e22f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:22.096514 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980315-4b30-4de7-b0ad-427ff03f3c46 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:22.096619 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81752ece-2c49-4dc7-8ef4-4a4913e22f28 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:22.096693 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980315-4b30-4de7-b0ad-427ff03f3c46 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:22.096762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81752ece-2c49-4dc7-8ef4-4a4913e22f28 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:22.096845 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980315-4b30-4de7-b0ad-427ff03f3c46 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:22.096917 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81752ece-2c49-4dc7-8ef4-4a4913e22f28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:22.097815 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 359/726] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:22.103107 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f85151-e833-46fc-bf43-e817ea7f401f None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:22.103387 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f85151-e833-46fc-bf43-e817ea7f401f None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:22.103655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f85151-e833-46fc-bf43-e817ea7f401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:22.104003 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81752ece-2c49-4dc7-8ef4-4a4913e22f28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:22.105426 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81752ece-2c49-4dc7-8ef4-4a4913e22f28 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-81752ece-2c49-4dc7-8ef4-4a4913e22f28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:54:22.117955 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:22.118970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:22.119893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:22.119893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:22.119893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:54:22.119893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:54:22.119893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:54:22.119893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:54:22.119893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:54:22.119893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:54:22.119893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 14:54:22.119893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:22.119893 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 368/727] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 31 14:54:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:22.125074 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81752ece-2c49-4dc7-8ef4-4a4913e22f28 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:22.125458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-d3f85151-e833-46fc-bf43-e817ea7f401f None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:22.126780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-d3f85151-e833-46fc-bf43-e817ea7f401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:22.157749 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:22.213339 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 360/728] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:22 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:22.240104 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81752ece-2c49-4dc7-8ef4-4a4913e22f28 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:22.247889 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f85151-e833-46fc-bf43-e817ea7f401f None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:22.248045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:22.283708 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709a221-925b-49ef-9b02-c11b73529fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:22.284321 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709a221-925b-49ef-9b02-c11b73529fc0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:22.284850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709a221-925b-49ef-9b02-c11b73529fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:22.285121 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709a221-925b-49ef-9b02-c11b73529fc0 None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:22.286773 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709a221-925b-49ef-9b02-c11b73529fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:22.287079 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709a221-925b-49ef-9b02-c11b73529fc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:22.288491 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709a221-925b-49ef-9b02-c11b73529fc0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:22.311351 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 369/729] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 31 14:54:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:22.317089 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709a221-925b-49ef-9b02-c11b73529fc0 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:22.364280 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f85151-e833-46fc-bf43-e817ea7f401f None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:22.406407 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27574968-9f98-48f2-97e3-711d392fe8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:22.407100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574968-9f98-48f2-97e3-711d392fe8e1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:22.407376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574968-9f98-48f2-97e3-711d392fe8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:22.407639 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574968-9f98-48f2-97e3-711d392fe8e1 None admin] PATH_INFO: `/v3/services/network` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:22.408238 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27574968-9f98-48f2-97e3-711d392fe8e1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:22.409599 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27574968-9f98-48f2-97e3-711d392fe8e1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-27574968-9f98-48f2-97e3-711d392fe8e1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:22.422471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:22.423534 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:22.424458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 361/730] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:22 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:22.434688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27574968-9f98-48f2-97e3-711d392fe8e1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:22.449265 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709a221-925b-49ef-9b02-c11b73529fc0 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:22.478724 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:22.492743 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7f90e-e5da-4a88-9c2f-9525ee3e8866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:22.493733 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7f90e-e5da-4a88-9c2f-9525ee3e8866 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:22.494074 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7f90e-e5da-4a88-9c2f-9525ee3e8866 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:22.498056 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7f90e-e5da-4a88-9c2f-9525ee3e8866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:22.534822 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:22.558919 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27574968-9f98-48f2-97e3-711d392fe8e1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:22.588945 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7f90e-e5da-4a88-9c2f-9525ee3e8866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:22.590333 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7f90e-e5da-4a88-9c2f-9525ee3e8866 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:22.597538 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b45c62-2ffb-4f4c-8fe3-670da837b85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:22.598142 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45c62-2ffb-4f4c-8fe3-670da837b85e None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:22.598491 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45c62-2ffb-4f4c-8fe3-670da837b85e None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:22.598757 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45c62-2ffb-4f4c-8fe3-670da837b85e None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:22.599532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b45c62-2ffb-4f4c-8fe3-670da837b85e None admin] RBAC: Adding query filter params (name=network) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:22.599836 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b45c62-2ffb-4f4c-8fe3-670da837b85e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:22.601801 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b45c62-2ffb-4f4c-8fe3-670da837b85e None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:22.611396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 362/731] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:22.611396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b45c62-2ffb-4f4c-8fe3-670da837b85e None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:22.705375 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 370/732] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:54:22 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 14:54:22.705574 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:22.705667 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7f90e-e5da-4a88-9c2f-9525ee3e8866 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:22.719390 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b45c62-2ffb-4f4c-8fe3-670da837b85e None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:22.755404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10691873-65f9-43d1-8974-f111cb55d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:22.756024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10691873-65f9-43d1-8974-f111cb55d80e None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:22.756305 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10691873-65f9-43d1-8974-f111cb55d80e None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:22.756580 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10691873-65f9-43d1-8974-f111cb55d80e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:22.757161 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10691873-65f9-43d1-8974-f111cb55d80e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:22.758768 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10691873-65f9-43d1-8974-f111cb55d80e None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-10691873-65f9-43d1-8974-f111cb55d80e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:22.767965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:22.768941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:22.769806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 363/733] 10.222.0.52 () {56 vars in 1129 bytes} [Wed Aug 31 14:54:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:22.771244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10691873-65f9-43d1-8974-f111cb55d80e None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:22.772081 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:22.819182 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7f90e-e5da-4a88-9c2f-9525ee3e8866 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:22.859072 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c01119-e6ea-486d-9264-b2ad8d4aecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:22.859700 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c01119-e6ea-486d-9264-b2ad8d4aecea None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:22.859977 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c01119-e6ea-486d-9264-b2ad8d4aecea None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:22.860245 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c01119-e6ea-486d-9264-b2ad8d4aecea None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:22.860869 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c01119-e6ea-486d-9264-b2ad8d4aecea None admin] RBAC: Adding query filter params (type=network) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:22.861167 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c01119-e6ea-486d-9264-b2ad8d4aecea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:22.862544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c01119-e6ea-486d-9264-b2ad8d4aecea None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:22.868460 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 371/734] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:22.869538 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c01119-e6ea-486d-9264-b2ad8d4aecea None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:22.898739 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10691873-65f9-43d1-8974-f111cb55d80e None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:22.936190 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba20d-5e1e-48a0-9e9c-7793d9b335ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:22.936821 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba20d-5e1e-48a0-9e9c-7793d9b335ba None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:22.937102 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba20d-5e1e-48a0-9e9c-7793d9b335ba None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:22.937424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba20d-5e1e-48a0-9e9c-7793d9b335ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:22.947981 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ba20d-5e1e-48a0-9e9c-7793d9b335ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:22.949463 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ba20d-5e1e-48a0-9e9c-7793d9b335ba None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-a90ba20d-5e1e-48a0-9e9c-7793d9b335ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:22.964735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:22.965826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:22.967188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:22.967188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:22.967188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:22.967188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 364/735] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:22.967188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba20d-5e1e-48a0-9e9c-7793d9b335ba None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:22.971738 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:22.982680 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c01119-e6ea-486d-9264-b2ad8d4aecea None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:23.010484 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:23.018226 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b79269-2037-4b21-a03b-43f64e279a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:23.018874 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b79269-2037-4b21-a03b-43f64e279a70 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:23.019159 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b79269-2037-4b21-a03b-43f64e279a70 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:23.019435 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b79269-2037-4b21-a03b-43f64e279a70 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:23.020061 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b79269-2037-4b21-a03b-43f64e279a70 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:23.020365 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b79269-2037-4b21-a03b-43f64e279a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:23.021779 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b79269-2037-4b21-a03b-43f64e279a70 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:23.027000 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 372/736] 10.222.0.52 () {56 vars in 1124 bytes} [Wed Aug 31 14:54:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:23.027788 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b79269-2037-4b21-a03b-43f64e279a70 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:23.092439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba20d-5e1e-48a0-9e9c-7793d9b335ba None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:23.130171 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc880c91-9d21-4d7e-8373-e13341a7ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:23.130881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b79269-2037-4b21-a03b-43f64e279a70 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:23.131220 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc880c91-9d21-4d7e-8373-e13341a7ae62 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:23.131647 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc880c91-9d21-4d7e-8373-e13341a7ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:23.132055 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc880c91-9d21-4d7e-8373-e13341a7ae62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:23.134066 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc880c91-9d21-4d7e-8373-e13341a7ae62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:23.135652 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc880c91-9d21-4d7e-8373-e13341a7ae62 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:23.166264 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2f3b-6c1b-4af8-a983-b050a270ef75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:23.166882 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2f3b-6c1b-4af8-a983-b050a270ef75 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:23.167160 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2f3b-6c1b-4af8-a983-b050a270ef75 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:23.167431 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2f3b-6c1b-4af8-a983-b050a270ef75 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:23.168066 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2f3b-6c1b-4af8-a983-b050a270ef75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:23.168365 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2f3b-6c1b-4af8-a983-b050a270ef75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:23.169701 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2f3b-6c1b-4af8-a983-b050a270ef75 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:23.182003 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 373/737] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:23.182834 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2f3b-6c1b-4af8-a983-b050a270ef75 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:23.213114 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 365/738] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 31 14:54:22 2022] POST /identity/v3/endpoints => generated 337 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:54:23.213948 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc880c91-9d21-4d7e-8373-e13341a7ae62 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:23.259289 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:23.297183 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:23.328459 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2f3b-6c1b-4af8-a983-b050a270ef75 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:23.360243 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc880c91-9d21-4d7e-8373-e13341a7ae62 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:23.380009 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91341db5-4f6c-44f0-a0a1-2384dd67b6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:23.381252 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91341db5-4f6c-44f0-a0a1-2384dd67b6dd None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:23.381767 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91341db5-4f6c-44f0-a0a1-2384dd67b6dd None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:23.382221 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91341db5-4f6c-44f0-a0a1-2384dd67b6dd None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:23.383957 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91341db5-4f6c-44f0-a0a1-2384dd67b6dd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:23.384577 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91341db5-4f6c-44f0-a0a1-2384dd67b6dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:23.386168 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91341db5-4f6c-44f0-a0a1-2384dd67b6dd None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:23.397146 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 374/739] 10.222.0.52 () {56 vars in 1124 bytes} [Wed Aug 31 14:54:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:23.400116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91341db5-4f6c-44f0-a0a1-2384dd67b6dd None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:23.404337 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af06d3-89ba-4ef6-b06e-fed49c0b65c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:23.405064 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af06d3-89ba-4ef6-b06e-fed49c0b65c4 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:23.405423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af06d3-89ba-4ef6-b06e-fed49c0b65c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:23.405769 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af06d3-89ba-4ef6-b06e-fed49c0b65c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:23.413536 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af06d3-89ba-4ef6-b06e-fed49c0b65c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:23.416015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af06d3-89ba-4ef6-b06e-fed49c0b65c4 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-a4af06d3-89ba-4ef6-b06e-fed49c0b65c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:54:23.429163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:23.431440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:23.432424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:54:23.432424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:54:23.432424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:54:23.432424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:54:23.432424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:54:23.432424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:54:23.432424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:23.432424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:23.432424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 366/740] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:23.436918 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af06d3-89ba-4ef6-b06e-fed49c0b65c4 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:23.522720 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91341db5-4f6c-44f0-a0a1-2384dd67b6dd None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:23.540963 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:23.559015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af06d3-89ba-4ef6-b06e-fed49c0b65c4 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:23.560620 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b45832-84a3-4f1f-a823-eabc966cec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:23.561223 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b45832-84a3-4f1f-a823-eabc966cec32 None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:23.561501 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b45832-84a3-4f1f-a823-eabc966cec32 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:23.561767 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b45832-84a3-4f1f-a823-eabc966cec32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:23.562456 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b45832-84a3-4f1f-a823-eabc966cec32 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:23.563941 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b45832-84a3-4f1f-a823-eabc966cec32 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:23.576455 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:23.593964 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f7bf6-ace8-4ee3-b06c-cfd0e26a7a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:23.594590 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f7bf6-ace8-4ee3-b06c-cfd0e26a7a72 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:23.594870 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f7bf6-ace8-4ee3-b06c-cfd0e26a7a72 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:23.595140 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f7bf6-ace8-4ee3-b06c-cfd0e26a7a72 None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:23.595821 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f7bf6-ace8-4ee3-b06c-cfd0e26a7a72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:23.596125 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f7bf6-ace8-4ee3-b06c-cfd0e26a7a72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:23.597548 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f7bf6-ace8-4ee3-b06c-cfd0e26a7a72 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:23.610452 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 367/741] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:54:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:23.611595 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b541447-77fd-472e-96fd-e4c678cdad5c None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:23.611875 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b541447-77fd-472e-96fd-e4c678cdad5c None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:23.612776 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b541447-77fd-472e-96fd-e4c678cdad5c None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:23.613305 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 368/742] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:23.616428 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b541447-77fd-472e-96fd-e4c678cdad5c None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:23.641679 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 375/743] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 31 14:54:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:54:23.642989 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5d6b1-8adc-4dd2-a73a-83244c4c9fda None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:23.643281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5d6b1-8adc-4dd2-a73a-83244c4c9fda None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:23.643557 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5d6b1-8adc-4dd2-a73a-83244c4c9fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:23.665029 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-b4f5d6b1-8adc-4dd2-a73a-83244c4c9fda None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:23.666459 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-b4f5d6b1-8adc-4dd2-a73a-83244c4c9fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:23.744306 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b541447-77fd-472e-96fd-e4c678cdad5c None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:23.747654 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 376/744] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:23 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:23.782817 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9c9b-3749-4a93-b828-54105410d999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:23.783432 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9c9b-3749-4a93-b828-54105410d999 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:23.783712 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9c9b-3749-4a93-b828-54105410d999 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:23.783983 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9c9b-3749-4a93-b828-54105410d999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:23.784728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff9c9b-3749-4a93-b828-54105410d999 None admin] RBAC: Adding query filter params (role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=98bb7c83115a45f1bdf9f48c6599db18) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:23.785043 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff9c9b-3749-4a93-b828-54105410d999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:23.786539 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff9c9b-3749-4a93-b828-54105410d999 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:23.799666 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 369/745] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:54:23 2022] GET /identity/v3/role_assignments?user.id=98bb7c83115a45f1bdf9f48c6599db18&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:24.076759 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5d6b1-8adc-4dd2-a73a-83244c4c9fda None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:24.180342 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5d6b1-8adc-4dd2-a73a-83244c4c9fda None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:24.181912 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:24.215750 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8de0b-1cc4-4175-b6a6-503ff2561ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:24.216358 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8de0b-1cc4-4175-b6a6-503ff2561ac0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:24.216635 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8de0b-1cc4-4175-b6a6-503ff2561ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:24.216903 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8de0b-1cc4-4175-b6a6-503ff2561ac0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:24.286689 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8de0b-1cc4-4175-b6a6-503ff2561ac0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:24.288126 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8de0b-1cc4-4175-b6a6-503ff2561ac0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:24.394422 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 377/746] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:54:24 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 14:54:24.396781 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9c9b-3749-4a93-b828-54105410d999 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:24.434321 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:24.499336 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9c9b-3749-4a93-b828-54105410d999 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:24.532749 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5b4ef-a00f-4269-a8dd-ba5927373063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:24.533369 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5b4ef-a00f-4269-a8dd-ba5927373063 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:24.533644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5b4ef-a00f-4269-a8dd-ba5927373063 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:24.533908 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5b4ef-a00f-4269-a8dd-ba5927373063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:24.545019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5b4ef-a00f-4269-a8dd-ba5927373063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:24.546696 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5b4ef-a00f-4269-a8dd-ba5927373063 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-2ce5b4ef-a00f-4269-a8dd-ba5927373063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:54:24.560543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:24.561490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:54:24.562423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:54:24.562423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:54:24.562423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:24.566516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 370/747] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:24.567718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8de0b-1cc4-4175-b6a6-503ff2561ac0 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:24.569816 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:24.670836 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8de0b-1cc4-4175-b6a6-503ff2561ac0 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:24.707729 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c78368-76f3-4623-8ed9-c028d28c5cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:24.708335 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c78368-76f3-4623-8ed9-c028d28c5cb5 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:24.708615 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c78368-76f3-4623-8ed9-c028d28c5cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:24.708886 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c78368-76f3-4623-8ed9-c028d28c5cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:24.709529 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c78368-76f3-4623-8ed9-c028d28c5cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:24.709829 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c78368-76f3-4623-8ed9-c028d28c5cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:24.712318 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c78368-76f3-4623-8ed9-c028d28c5cb5 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:24.724637 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 378/748] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:25.905568 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329e55-f8a7-4442-95d6-1e61ed4d61ec None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:25.906148 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329e55-f8a7-4442-95d6-1e61ed4d61ec None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:25.906148 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329e55-f8a7-4442-95d6-1e61ed4d61ec None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:25.907500 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 371/749] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:25.913308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72005c61-05dd-441a-b936-0df2c522c515 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:25.913816 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72005c61-05dd-441a-b936-0df2c522c515 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:25.913937 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72005c61-05dd-441a-b936-0df2c522c515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:25.932379 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-72005c61-05dd-441a-b936-0df2c522c515 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:25.933547 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-72005c61-05dd-441a-b936-0df2c522c515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:25.989091 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:26.000169 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 379/750] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:25 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:26.056717 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98fff0-8efc-4e89-94eb-bb9c64a15c68 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:26.056995 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98fff0-8efc-4e89-94eb-bb9c64a15c68 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:26.057264 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98fff0-8efc-4e89-94eb-bb9c64a15c68 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:26.058635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 372/751] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:26.063906 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4b33a-4df3-4ebf-9d66-ebccb876125d None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:26.064194 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4b33a-4df3-4ebf-9d66-ebccb876125d None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:26.064469 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4b33a-4df3-4ebf-9d66-ebccb876125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:26.082793 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-d0e4b33a-4df3-4ebf-9d66-ebccb876125d None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:26.083962 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-d0e4b33a-4df3-4ebf-9d66-ebccb876125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:26.151525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 380/752] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:26 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:26.327943 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98fff0-8efc-4e89-94eb-bb9c64a15c68 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:26.414649 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:26.426932 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98fff0-8efc-4e89-94eb-bb9c64a15c68 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:26.461654 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93fe80-d2ae-4f85-968a-21be5b2c7fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:26.462256 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93fe80-d2ae-4f85-968a-21be5b2c7fcc None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:26.462560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93fe80-d2ae-4f85-968a-21be5b2c7fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:26.462827 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93fe80-d2ae-4f85-968a-21be5b2c7fcc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:26.463394 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93fe80-d2ae-4f85-968a-21be5b2c7fcc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:26.464740 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93fe80-d2ae-4f85-968a-21be5b2c7fcc None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-1d93fe80-d2ae-4f85-968a-21be5b2c7fcc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:26.473175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:26.474251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:26.475124 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 373/753] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:54:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:26.478990 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4b33a-4df3-4ebf-9d66-ebccb876125d None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:26.480055 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93fe80-d2ae-4f85-968a-21be5b2c7fcc None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:26.577879 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4b33a-4df3-4ebf-9d66-ebccb876125d None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:26.579735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93fe80-d2ae-4f85-968a-21be5b2c7fcc None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:26.601683 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:26.613174 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9cff9-05d2-466d-bba5-531cba186dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:26.613764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9cff9-05d2-466d-bba5-531cba186dff None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:26.613863 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a12f1d-7c41-41b6-93cf-8f9828fa16bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:26.614039 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9cff9-05d2-466d-bba5-531cba186dff None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:26.614342 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9cff9-05d2-466d-bba5-531cba186dff None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:26.614504 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a12f1d-7c41-41b6-93cf-8f9828fa16bf None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:26.614786 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a12f1d-7c41-41b6-93cf-8f9828fa16bf None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:26.614956 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9cff9-05d2-466d-bba5-531cba186dff None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:26.615061 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a12f1d-7c41-41b6-93cf-8f9828fa16bf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:26.615253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9cff9-05d2-466d-bba5-531cba186dff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:26.615738 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a12f1d-7c41-41b6-93cf-8f9828fa16bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:26.616648 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9cff9-05d2-466d-bba5-531cba186dff None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:26.617109 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a12f1d-7c41-41b6-93cf-8f9828fa16bf None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:26.621310 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 374/754] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:54:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-c3a12f1d-7c41-41b6-93cf-8f9828fa16bf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:26.625848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:26.626771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 14:54:26.627690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:26.628440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9cff9-05d2-466d-bba5-531cba186dff None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:26.628512 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 381/755] 10.222.0.52 () {56 vars in 1132 bytes} [Wed Aug 31 14:54:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:26.632982 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a12f1d-7c41-41b6-93cf-8f9828fa16bf None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:26.645725 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:26.726367 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9cff9-05d2-466d-bba5-531cba186dff None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:26.730631 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a12f1d-7c41-41b6-93cf-8f9828fa16bf None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:26.760617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a57a78-7a99-4a06-bfe0-f53ad35c9428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:26.761213 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a57a78-7a99-4a06-bfe0-f53ad35c9428 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:26.761487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a57a78-7a99-4a06-bfe0-f53ad35c9428 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:26.761751 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a57a78-7a99-4a06-bfe0-f53ad35c9428 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:26.762393 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a57a78-7a99-4a06-bfe0-f53ad35c9428 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:26.762689 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a57a78-7a99-4a06-bfe0-f53ad35c9428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:26.764384 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a57a78-7a99-4a06-bfe0-f53ad35c9428 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:26.764642 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e23da-6bcf-4027-afff-27228a4e49d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:26.765248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e23da-6bcf-4027-afff-27228a4e49d3 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:26.765693 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e23da-6bcf-4027-afff-27228a4e49d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:26.765971 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e23da-6bcf-4027-afff-27228a4e49d3 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:26.766632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e23da-6bcf-4027-afff-27228a4e49d3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:26.766934 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e23da-6bcf-4027-afff-27228a4e49d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:26.768280 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e23da-6bcf-4027-afff-27228a4e49d3 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:26.768736 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 375/756] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:54:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:26.777659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 382/757] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 31 14:54:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:26.779004 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a57a78-7a99-4a06-bfe0-f53ad35c9428 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:26.869099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:26.889054 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a57a78-7a99-4a06-bfe0-f53ad35c9428 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:26.926162 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7bdf1-35ed-4d82-ae8a-3aa0ad7a0ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:26.926920 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7bdf1-35ed-4d82-ae8a-3aa0ad7a0ead None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:26.927062 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7bdf1-35ed-4d82-ae8a-3aa0ad7a0ead None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:26.927326 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7bdf1-35ed-4d82-ae8a-3aa0ad7a0ead None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:26.927951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7bdf1-35ed-4d82-ae8a-3aa0ad7a0ead None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:26.928248 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7bdf1-35ed-4d82-ae8a-3aa0ad7a0ead None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:26.930174 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7bdf1-35ed-4d82-ae8a-3aa0ad7a0ead None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:26.935036 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 376/758] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 31 14:54:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:28.973013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd20529-5e0f-49ce-962e-f0cab78de57e None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:28.973565 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd20529-5e0f-49ce-962e-f0cab78de57e None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:28.973565 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd20529-5e0f-49ce-962e-f0cab78de57e None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:28.974908 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 383/759] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:28.980865 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7012c7-36f0-4177-b930-d98d769ff5b8 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:28.981272 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7012c7-36f0-4177-b930-d98d769ff5b8 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:28.981416 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7012c7-36f0-4177-b930-d98d769ff5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:28.999799 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-8c7012c7-36f0-4177-b930-d98d769ff5b8 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:29.000979 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-8c7012c7-36f0-4177-b930-d98d769ff5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:29.068864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 377/760] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:28 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:29.081120 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e2cba-59d4-4c30-aa68-b6a09e245b92 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:29.081403 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e2cba-59d4-4c30-aa68-b6a09e245b92 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:29.081676 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e2cba-59d4-4c30-aa68-b6a09e245b92 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:29.083029 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 384/761] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:29.088655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a685a-5769-4ffe-87b1-7d7aae4d5d15 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:29.088936 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a685a-5769-4ffe-87b1-7d7aae4d5d15 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:29.089205 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a685a-5769-4ffe-87b1-7d7aae4d5d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:29.112431 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-d48a685a-5769-4ffe-87b1-7d7aae4d5d15 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:29.112431 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-d48a685a-5769-4ffe-87b1-7d7aae4d5d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:29.174695 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 378/762] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:29 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:29.403223 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e2cba-59d4-4c30-aa68-b6a09e245b92 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:29.453069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:29.500170 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a685a-5769-4ffe-87b1-7d7aae4d5d15 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:29.503230 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:29.504306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e2cba-59d4-4c30-aa68-b6a09e245b92 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:29.537964 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02c1d3-d2b4-4afb-9bdf-a1884c21826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:29.539095 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02c1d3-d2b4-4afb-9bdf-a1884c21826c None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:29.539376 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02c1d3-d2b4-4afb-9bdf-a1884c21826c None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:29.539648 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02c1d3-d2b4-4afb-9bdf-a1884c21826c None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:29.540294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02c1d3-d2b4-4afb-9bdf-a1884c21826c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:29.541671 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02c1d3-d2b4-4afb-9bdf-a1884c21826c None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:29.600045 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a685a-5769-4ffe-87b1-7d7aae4d5d15 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:29.606580 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 385/763] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 31 14:54:29 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:54:29.646379 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd5e28-ca06-4413-88b0-c63cc6117dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:29.647015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd5e28-ca06-4413-88b0-c63cc6117dcb None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:29.647295 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd5e28-ca06-4413-88b0-c63cc6117dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:29.647560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd5e28-ca06-4413-88b0-c63cc6117dcb None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:29.648756 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd5e28-ca06-4413-88b0-c63cc6117dcb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:29.650168 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd5e28-ca06-4413-88b0-c63cc6117dcb None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:29.738922 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 379/764] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 31 14:54:29 2022] POST /identity/v3/services => generated 269 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 14:54:31.849807 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d303722-2402-4331-b403-685d52c3bc32 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:31.850245 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d303722-2402-4331-b403-685d52c3bc32 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:31.850419 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d303722-2402-4331-b403-685d52c3bc32 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:31.852480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 386/765] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:31.857666 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cce247-990b-4791-a89d-1fce1e2ba47f None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:31.858405 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cce247-990b-4791-a89d-1fce1e2ba47f None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:31.858618 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cce247-990b-4791-a89d-1fce1e2ba47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:31.877390 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-c6cce247-990b-4791-a89d-1fce1e2ba47f None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:31.878595 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-c6cce247-990b-4791-a89d-1fce1e2ba47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:31.926941 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406d2f0-90a7-4334-85e8-fa7c30cc070e None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:31.927230 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406d2f0-90a7-4334-85e8-fa7c30cc070e None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:31.927506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406d2f0-90a7-4334-85e8-fa7c30cc070e None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:31.928820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 387/766] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:31.933543 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0602cab-f05d-485b-9ba4-9d13c15c8fd2 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:31.933825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0602cab-f05d-485b-9ba4-9d13c15c8fd2 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:31.934098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0602cab-f05d-485b-9ba4-9d13c15c8fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:31.934516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:31.951485 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 380/767] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:31 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:31.951672 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-c0602cab-f05d-485b-9ba4-9d13c15c8fd2 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:31.952756 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-c0602cab-f05d-485b-9ba4-9d13c15c8fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:32.019378 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 388/768] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:31 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 14:54:32.290474 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cce247-990b-4791-a89d-1fce1e2ba47f None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:32.369973 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0602cab-f05d-485b-9ba4-9d13c15c8fd2 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:32.395002 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cce247-990b-4791-a89d-1fce1e2ba47f None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:32.410349 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:32.428781 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd01b9-8c71-4610-b084-3ade8c7ce439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:32.430160 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd01b9-8c71-4610-b084-3ade8c7ce439 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:32.430579 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd01b9-8c71-4610-b084-3ade8c7ce439 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:32.430854 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd01b9-8c71-4610-b084-3ade8c7ce439 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:32.431432 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd01b9-8c71-4610-b084-3ade8c7ce439 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:32.432920 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd01b9-8c71-4610-b084-3ade8c7ce439 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-91bd01b9-8c71-4610-b084-3ade8c7ce439 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:32.442185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:32.449357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:32.450644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 381/769] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:54:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:32.452550 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd01b9-8c71-4610-b084-3ade8c7ce439 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:32.471586 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0602cab-f05d-485b-9ba4-9d13c15c8fd2 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:32.501605 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:32.505361 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4da33-cf0d-447f-8025-ffc6c20268c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:32.505987 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4da33-cf0d-447f-8025-ffc6c20268c6 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:32.506265 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4da33-cf0d-447f-8025-ffc6c20268c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:32.506565 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4da33-cf0d-447f-8025-ffc6c20268c6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:32.507146 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4da33-cf0d-447f-8025-ffc6c20268c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:32.509019 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4da33-cf0d-447f-8025-ffc6c20268c6 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-ead4da33-cf0d-447f-8025-ffc6c20268c6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:32.517638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:32.518611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:32.519493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 389/770] 10.222.0.52 () {56 vars in 1132 bytes} [Wed Aug 31 14:54:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:32.525469 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4da33-cf0d-447f-8025-ffc6c20268c6 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:32.553063 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd01b9-8c71-4610-b084-3ade8c7ce439 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:32.587339 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e85e7-5340-49d2-bfd5-bcc08614317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:32.587945 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e85e7-5340-49d2-bfd5-bcc08614317b None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:32.588225 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e85e7-5340-49d2-bfd5-bcc08614317b None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:32.588496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e85e7-5340-49d2-bfd5-bcc08614317b None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:32.589300 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e85e7-5340-49d2-bfd5-bcc08614317b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:32.589606 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e85e7-5340-49d2-bfd5-bcc08614317b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:32.591007 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e85e7-5340-49d2-bfd5-bcc08614317b None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:32.595619 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 382/771] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:54:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:32.601871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e85e7-5340-49d2-bfd5-bcc08614317b None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:32.629432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4da33-cf0d-447f-8025-ffc6c20268c6 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:32.631808 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:32.664402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed477e-4d58-45aa-9daf-44ec2c9b0485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:32.665004 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed477e-4d58-45aa-9daf-44ec2c9b0485 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:32.665277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed477e-4d58-45aa-9daf-44ec2c9b0485 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:32.665543 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed477e-4d58-45aa-9daf-44ec2c9b0485 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:32.666163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed477e-4d58-45aa-9daf-44ec2c9b0485 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:32.666483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed477e-4d58-45aa-9daf-44ec2c9b0485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:32.667831 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed477e-4d58-45aa-9daf-44ec2c9b0485 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:32.672581 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 390/772] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 31 14:54:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:32.678185 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed477e-4d58-45aa-9daf-44ec2c9b0485 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:32.707271 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e85e7-5340-49d2-bfd5-bcc08614317b None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:32.721237 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:32.741545 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa572f7f-5aa0-4bb0-8038-06ff9d0f63b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:32.742190 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa572f7f-5aa0-4bb0-8038-06ff9d0f63b0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:32.742499 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa572f7f-5aa0-4bb0-8038-06ff9d0f63b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:32.742773 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa572f7f-5aa0-4bb0-8038-06ff9d0f63b0 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:32.743398 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa572f7f-5aa0-4bb0-8038-06ff9d0f63b0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:32.743703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa572f7f-5aa0-4bb0-8038-06ff9d0f63b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:32.745065 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa572f7f-5aa0-4bb0-8038-06ff9d0f63b0 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:32.750260 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 383/773] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:54:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:32.756147 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa572f7f-5aa0-4bb0-8038-06ff9d0f63b0 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:32.777354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed477e-4d58-45aa-9daf-44ec2c9b0485 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:32.811192 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c0560-a5b0-4099-8605-05f665cae69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:32.811739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0560-a5b0-4099-8605-05f665cae69a None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:32.812027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0560-a5b0-4099-8605-05f665cae69a None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:32.812299 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0560-a5b0-4099-8605-05f665cae69a None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:32.812923 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c0560-a5b0-4099-8605-05f665cae69a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:32.813224 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c0560-a5b0-4099-8605-05f665cae69a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:32.814605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c0560-a5b0-4099-8605-05f665cae69a None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:32.819345 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 391/774] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 31 14:54:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:32.825983 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c0560-a5b0-4099-8605-05f665cae69a None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:32.857251 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:32.864094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa572f7f-5aa0-4bb0-8038-06ff9d0f63b0 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:32.898271 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8305f-98ce-42c6-885c-876edb979429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:32.898937 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8305f-98ce-42c6-885c-876edb979429 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:32.899215 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8305f-98ce-42c6-885c-876edb979429 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:32.899482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8305f-98ce-42c6-885c-876edb979429 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:32.900210 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8305f-98ce-42c6-885c-876edb979429 None admin] RBAC: Adding query filter params (interface=public, service_id=96c09e86266c47bfabfe13a89f767fca, region_id=RegionOne) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:32.900510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8305f-98ce-42c6-885c-876edb979429 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:32.901936 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8305f-98ce-42c6-885c-876edb979429 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:32.909506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 384/775] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 31 14:54:32 2022] GET /identity/v3/endpoints?service_id=96c09e86266c47bfabfe13a89f767fca&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:32.915392 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8305f-98ce-42c6-885c-876edb979429 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:32.930168 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c0560-a5b0-4099-8605-05f665cae69a None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:32.963488 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:32.964736 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902330d-1955-463f-80ad-47b054521580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:32.965339 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902330d-1955-463f-80ad-47b054521580 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:32.965615 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902330d-1955-463f-80ad-47b054521580 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:32.965882 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902330d-1955-463f-80ad-47b054521580 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:32.966612 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902330d-1955-463f-80ad-47b054521580 None admin] RBAC: Adding query filter params (interface=public, service_id=e051bd5834c144e3882c3d728f16b1c0, region_id=RegionOne) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:32.966913 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902330d-1955-463f-80ad-47b054521580 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:32.968249 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902330d-1955-463f-80ad-47b054521580 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:32.973026 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 392/776] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 31 14:54:32 2022] GET /identity/v3/endpoints?service_id=e051bd5834c144e3882c3d728f16b1c0&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:32.978856 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902330d-1955-463f-80ad-47b054521580 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:33.021632 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8305f-98ce-42c6-885c-876edb979429 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:33.056029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d84e1-03d0-4f81-8899-bc215dc5e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:33.056629 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d84e1-03d0-4f81-8899-bc215dc5e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:33.056914 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d84e1-03d0-4f81-8899-bc215dc5e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:33.057186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d84e1-03d0-4f81-8899-bc215dc5e7c0 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:33.057782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d84e1-03d0-4f81-8899-bc215dc5e7c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:33.059185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d84e1-03d0-4f81-8899-bc215dc5e7c0 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:33.065256 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 385/777] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 31 14:54:32 2022] GET /identity/v3/services => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 14:54:33.071272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:33.077399 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902330d-1955-463f-80ad-47b054521580 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:33.115083 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33dd8e-19bd-4171-87af-bba8d9631fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:33.115704 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33dd8e-19bd-4171-87af-bba8d9631fed None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:33.115987 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33dd8e-19bd-4171-87af-bba8d9631fed None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:33.116258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33dd8e-19bd-4171-87af-bba8d9631fed None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:33.117543 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33dd8e-19bd-4171-87af-bba8d9631fed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:33.118984 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33dd8e-19bd-4171-87af-bba8d9631fed None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:33.125774 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 393/778] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 31 14:54:32 2022] GET /identity/v3/services => generated 1498 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 14:54:35.242877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab0b07-32af-4b03-94df-f6753ad11928 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:35.243472 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab0b07-32af-4b03-94df-f6753ad11928 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:35.243472 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab0b07-32af-4b03-94df-f6753ad11928 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:35.244771 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 386/779] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:35.249860 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8104c4-d77f-4a27-a237-571a5370b500 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:35.250320 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8104c4-d77f-4a27-a237-571a5370b500 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:35.250451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8104c4-d77f-4a27-a237-571a5370b500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:35.269167 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-5c8104c4-d77f-4a27-a237-571a5370b500 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:35.270398 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-5c8104c4-d77f-4a27-a237-571a5370b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:35.335792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715c626-10ab-43d8-a149-d947f10c66b6 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:35.336237 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715c626-10ab-43d8-a149-d947f10c66b6 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:35.336654 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715c626-10ab-43d8-a149-d947f10c66b6 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:35.338174 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 387/780] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:35.341754 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 394/781] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:35 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:35.343042 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ce25b-4ff6-479a-ba97-5d7b1fbbfdf5 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:35.343322 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ce25b-4ff6-479a-ba97-5d7b1fbbfdf5 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:35.343593 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ce25b-4ff6-479a-ba97-5d7b1fbbfdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:35.362211 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-d08ce25b-4ff6-479a-ba97-5d7b1fbbfdf5 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:35.363413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-d08ce25b-4ff6-479a-ba97-5d7b1fbbfdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:35.434752 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 388/782] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:35 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:35.667452 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8104c4-d77f-4a27-a237-571a5370b500 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:35.755474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:35.765061 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8104c4-d77f-4a27-a237-571a5370b500 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:35.772438 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ce25b-4ff6-479a-ba97-5d7b1fbbfdf5 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:35.801122 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217d69-f37e-4c9c-9d53-a8f7d1c88193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:35.801751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217d69-f37e-4c9c-9d53-a8f7d1c88193 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:35.802025 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217d69-f37e-4c9c-9d53-a8f7d1c88193 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:35.802390 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217d69-f37e-4c9c-9d53-a8f7d1c88193 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:35.802899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83217d69-f37e-4c9c-9d53-a8f7d1c88193 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:35.804969 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83217d69-f37e-4c9c-9d53-a8f7d1c88193 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:35.808690 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-83217d69-f37e-4c9c-9d53-a8f7d1c88193 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:35.813311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:35.817711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:35.818713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 395/783] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:54:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:35.820357 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217d69-f37e-4c9c-9d53-a8f7d1c88193 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:35.879156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ce25b-4ff6-479a-ba97-5d7b1fbbfdf5 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:35.912800 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f7960-0a4e-4d91-943e-07b8117f5f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:35.913462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f7960-0a4e-4d91-943e-07b8117f5f7f None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:35.914271 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f7960-0a4e-4d91-943e-07b8117f5f7f None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:35.914567 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f7960-0a4e-4d91-943e-07b8117f5f7f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:35.915152 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f7960-0a4e-4d91-943e-07b8117f5f7f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:35.916516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f7960-0a4e-4d91-943e-07b8117f5f7f None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:35.922205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217d69-f37e-4c9c-9d53-a8f7d1c88193 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-f99f7960-0a4e-4d91-943e-07b8117f5f7f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:35.925099 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:35.926100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:35.927338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 389/784] 10.222.0.52 () {56 vars in 1132 bytes} [Wed Aug 31 14:54:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:35.932092 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f7960-0a4e-4d91-943e-07b8117f5f7f None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:35.959011 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eba2aa-dc6d-47c7-bc3d-c63f09036281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:35.959613 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba2aa-dc6d-47c7-bc3d-c63f09036281 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:35.959891 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba2aa-dc6d-47c7-bc3d-c63f09036281 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:35.960164 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba2aa-dc6d-47c7-bc3d-c63f09036281 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:35.961430 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eba2aa-dc6d-47c7-bc3d-c63f09036281 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:35.961732 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eba2aa-dc6d-47c7-bc3d-c63f09036281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:35.963126 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eba2aa-dc6d-47c7-bc3d-c63f09036281 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:35.967694 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 396/785] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:54:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:35.973439 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eba2aa-dc6d-47c7-bc3d-c63f09036281 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:35.992599 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:36.030687 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:36.033574 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f7960-0a4e-4d91-943e-07b8117f5f7f None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:36.067758 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be18c9a-c14a-4272-b0ee-fa49ebf38bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:36.068358 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be18c9a-c14a-4272-b0ee-fa49ebf38bcc None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:36.068649 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be18c9a-c14a-4272-b0ee-fa49ebf38bcc None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:36.068922 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be18c9a-c14a-4272-b0ee-fa49ebf38bcc None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:36.069547 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be18c9a-c14a-4272-b0ee-fa49ebf38bcc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:36.070467 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be18c9a-c14a-4272-b0ee-fa49ebf38bcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:36.071838 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be18c9a-c14a-4272-b0ee-fa49ebf38bcc None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:36.076448 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 390/786] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 31 14:54:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:36.076582 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eba2aa-dc6d-47c7-bc3d-c63f09036281 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:36.082145 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be18c9a-c14a-4272-b0ee-fa49ebf38bcc None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:36.111934 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc18b7d-730d-4b26-9705-e58a917a09aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:36.112538 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18b7d-730d-4b26-9705-e58a917a09aa None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:36.112822 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18b7d-730d-4b26-9705-e58a917a09aa None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:36.113094 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18b7d-730d-4b26-9705-e58a917a09aa None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:36.113723 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc18b7d-730d-4b26-9705-e58a917a09aa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:36.114028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc18b7d-730d-4b26-9705-e58a917a09aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:36.115417 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc18b7d-730d-4b26-9705-e58a917a09aa None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:36.120172 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 397/787] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 31 14:54:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:36.126032 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc18b7d-730d-4b26-9705-e58a917a09aa None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:36.181430 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be18c9a-c14a-4272-b0ee-fa49ebf38bcc None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:36.206398 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:36.216440 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e166dc2-a5d5-4368-9ab1-f7eb0651b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:36.220129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e166dc2-a5d5-4368-9ab1-f7eb0651b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:36.220129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e166dc2-a5d5-4368-9ab1-f7eb0651b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:36.220129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e166dc2-a5d5-4368-9ab1-f7eb0651b3a2 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:36.220129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e166dc2-a5d5-4368-9ab1-f7eb0651b3a2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:36.220129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e166dc2-a5d5-4368-9ab1-f7eb0651b3a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:36.220129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e166dc2-a5d5-4368-9ab1-f7eb0651b3a2 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:36.224603 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 391/788] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 31 14:54:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:36.224802 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc18b7d-730d-4b26-9705-e58a917a09aa None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:36.230671 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e166dc2-a5d5-4368-9ab1-f7eb0651b3a2 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:36.258994 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:36.264189 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58adaad-57a6-4985-bf14-8f79c5919c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:36.271178 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58adaad-57a6-4985-bf14-8f79c5919c58 None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:36.271178 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58adaad-57a6-4985-bf14-8f79c5919c58 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:36.271178 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58adaad-57a6-4985-bf14-8f79c5919c58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:36.271178 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58adaad-57a6-4985-bf14-8f79c5919c58 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:36.271178 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58adaad-57a6-4985-bf14-8f79c5919c58 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:36.329960 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e166dc2-a5d5-4368-9ab1-f7eb0651b3a2 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:36.348962 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 398/789] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 31 14:54:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:54:36.378032 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e779510-2a37-4e31-868d-d6d5f030ce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:36.378694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e779510-2a37-4e31-868d-d6d5f030ce78 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:36.378975 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e779510-2a37-4e31-868d-d6d5f030ce78 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:36.379248 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e779510-2a37-4e31-868d-d6d5f030ce78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:36.379929 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e779510-2a37-4e31-868d-d6d5f030ce78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:36.381339 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e779510-2a37-4e31-868d-d6d5f030ce78 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:36.469678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 392/790] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 31 14:54:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 14:54:38.542203 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35331d-80b7-4752-91d7-97aceeab4af8 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:38.542792 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35331d-80b7-4752-91d7-97aceeab4af8 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:38.542792 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35331d-80b7-4752-91d7-97aceeab4af8 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:38.544112 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 399/791] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:38.549257 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a481c72-87a1-4207-810e-60ef4953894e None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:38.549649 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a481c72-87a1-4207-810e-60ef4953894e None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:38.549811 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a481c72-87a1-4207-810e-60ef4953894e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:38.568291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-8a481c72-87a1-4207-810e-60ef4953894e None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:38.569479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-8a481c72-87a1-4207-810e-60ef4953894e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:38.641631 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 393/792] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:38 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:38.653724 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37832f9-250e-4450-b532-61739d3df2d8 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:38.654093 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37832f9-250e-4450-b532-61739d3df2d8 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:38.654474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37832f9-250e-4450-b532-61739d3df2d8 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:38.655887 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 400/793] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:38.660815 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab9c4-9d18-4f60-80d3-9643a014d759 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:38.661107 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab9c4-9d18-4f60-80d3-9643a014d759 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:38.661388 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab9c4-9d18-4f60-80d3-9643a014d759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:38.673533 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:38.680393 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-6a7ab9c4-9d18-4f60-80d3-9643a014d759 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:38.681627 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-6a7ab9c4-9d18-4f60-80d3-9643a014d759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:38.747215 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 394/794] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:38 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:38.965948 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37832f9-250e-4450-b532-61739d3df2d8 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:39.069088 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37832f9-250e-4450-b532-61739d3df2d8 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:39.071519 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ab9c4-9d18-4f60-80d3-9643a014d759 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:39.105944 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31283603-97aa-4c97-a67d-d149c56859f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:39.106505 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283603-97aa-4c97-a67d-d149c56859f7 None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:39.106781 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283603-97aa-4c97-a67d-d149c56859f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:39.107051 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283603-97aa-4c97-a67d-d149c56859f7 None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:39.107692 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31283603-97aa-4c97-a67d-d149c56859f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:39.109360 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31283603-97aa-4c97-a67d-d149c56859f7 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:39.111946 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: WARNING keystone.server.flask.common [None req-31283603-97aa-4c97-a67d-d149c56859f7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 14:54:39.120352 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:39.170864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ab9c4-9d18-4f60-80d3-9643a014d759 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:39.176711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.sql.core [None req-31283603-97aa-4c97-a67d-d149c56859f7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 14:54:39.176711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 14:54:39.176711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [parameters: {'id': 'd030a357fcbc46e99b2a42f62eb936f0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 14:54:39.176711 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88467) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-31283603-97aa-4c97-a67d-d149c56859f7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d030a357fcbc46e99b2a42f62eb936f0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d030a357fcbc46e99b2a42f62eb936f0. Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application conn.query(q) Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 14:54:39.192664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application result.read() Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 14:54:39.193766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application next(self.gen) Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application yield resource Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application next(self.gen) Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise self.value Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application session.commit() Aug 31 14:54:39.195530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self.session.flush() Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application compat.raise_( Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 14:54:39.196907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 14:54:39.198027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application conn.query(q) Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application result.read() Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 14:54:39.199098 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [parameters: {'id': 'd030a357fcbc46e99b2a42f62eb936f0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:39.200634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:39.202078 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:39.203483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:39.203483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 14:54:39.203483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 14:54:39.203483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:39.203483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:39.203483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 14:54:39.203483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 14:54:39.203483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d030a357fcbc46e99b2a42f62eb936f0. Aug 31 14:54:39.203483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:39.203483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 401/795] 10.222.0.52 () {60 vars in 1140 bytes} [Wed Aug 31 14:54:38 2022] POST /identity/v3/projects => generated 262 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:39.203483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31283603-97aa-4c97-a67d-d149c56859f7 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:39.212027 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eea877-26d3-497e-911d-860724d03556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:39.212665 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eea877-26d3-497e-911d-860724d03556 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:39.212946 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eea877-26d3-497e-911d-860724d03556 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:39.213219 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eea877-26d3-497e-911d-860724d03556 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:39.213808 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eea877-26d3-497e-911d-860724d03556 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:39.215226 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eea877-26d3-497e-911d-860724d03556 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:39.218567 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-a2eea877-26d3-497e-911d-860724d03556 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:39.225291 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:39.229714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:39.230582 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 395/796] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:39.232505 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eea877-26d3-497e-911d-860724d03556 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:39.304362 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31283603-97aa-4c97-a67d-d149c56859f7 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:39.333115 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eea877-26d3-497e-911d-860724d03556 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:39.338259 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2ad21-ffca-4ea9-be5f-bb9e69e48074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:39.338941 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2ad21-ffca-4ea9-be5f-bb9e69e48074 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:39.339217 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2ad21-ffca-4ea9-be5f-bb9e69e48074 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:39.339488 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2ad21-ffca-4ea9-be5f-bb9e69e48074 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:39.346001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2ad21-ffca-4ea9-be5f-bb9e69e48074 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:39.347671 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2ad21-ffca-4ea9-be5f-bb9e69e48074 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-79a2ad21-ffca-4ea9-be5f-bb9e69e48074 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:54:39.360605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:39.361598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:39.362549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:54:39.362549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:54:39.362549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:54:39.362549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:54:39.362549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:54:39.362549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:54:39.362549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:54:39.362549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:39.362549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 402/797] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:39.367370 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2ad21-ffca-4ea9-be5f-bb9e69e48074 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:39.368203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9c09b-9ad2-4d05-b89d-162dc28a3fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:39.368879 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9c09b-9ad2-4d05-b89d-162dc28a3fa4 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:39.369239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9c09b-9ad2-4d05-b89d-162dc28a3fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:39.369575 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9c09b-9ad2-4d05-b89d-162dc28a3fa4 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:39.370269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9c09b-9ad2-4d05-b89d-162dc28a3fa4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:39.370613 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9c09b-9ad2-4d05-b89d-162dc28a3fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:39.371983 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9c09b-9ad2-4d05-b89d-162dc28a3fa4 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:39.376664 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 396/798] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:39.382103 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9c09b-9ad2-4d05-b89d-162dc28a3fa4 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:39.422197 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:39.443450 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:39.467146 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2ad21-ffca-4ea9-be5f-bb9e69e48074 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:39.480344 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9c09b-9ad2-4d05-b89d-162dc28a3fa4 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:39.500866 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6de21-cb2f-432b-9225-8ead97b832e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:39.501534 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6de21-cb2f-432b-9225-8ead97b832e1 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:39.501825 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6de21-cb2f-432b-9225-8ead97b832e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:39.502404 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6de21-cb2f-432b-9225-8ead97b832e1 None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:39.503236 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6de21-cb2f-432b-9225-8ead97b832e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:39.504300 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6de21-cb2f-432b-9225-8ead97b832e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:39.506073 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6de21-cb2f-432b-9225-8ead97b832e1 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:39.515878 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef53266-44ac-4514-a49b-e4de66f62ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:39.516478 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef53266-44ac-4514-a49b-e4de66f62ecc None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:39.516763 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef53266-44ac-4514-a49b-e4de66f62ecc None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:39.517035 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef53266-44ac-4514-a49b-e4de66f62ecc None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:39.517649 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef53266-44ac-4514-a49b-e4de66f62ecc None admin] RBAC: Adding query filter params (type=compute) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:39.517948 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef53266-44ac-4514-a49b-e4de66f62ecc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:39.519359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef53266-44ac-4514-a49b-e4de66f62ecc None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:39.523974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 397/799] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:39.526619 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 403/800] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:41.744444 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99c460-af30-4a64-8fba-57324096d165 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:41.745001 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99c460-af30-4a64-8fba-57324096d165 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:41.745001 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99c460-af30-4a64-8fba-57324096d165 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:41.746487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 398/801] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:41.751656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0b45-2e26-4aee-a586-e5a648c6276e None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:41.752097 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0b45-2e26-4aee-a586-e5a648c6276e None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:41.752192 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0b45-2e26-4aee-a586-e5a648c6276e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:41.771409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-ebae0b45-2e26-4aee-a586-e5a648c6276e None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:41.772927 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-ebae0b45-2e26-4aee-a586-e5a648c6276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:41.797961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc815db3-b82f-430c-a3c6-2aac70f3a1f8 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:41.798244 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc815db3-b82f-430c-a3c6-2aac70f3a1f8 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:41.798556 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc815db3-b82f-430c-a3c6-2aac70f3a1f8 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:41.799955 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 399/802] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 14:54:41.805392 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b8f0-62aa-47dc-9993-792a6d1c7537 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:41.805734 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b8f0-62aa-47dc-9993-792a6d1c7537 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:41.806071 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b8f0-62aa-47dc-9993-792a6d1c7537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:41.824370 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-4d86b8f0-62aa-47dc-9993-792a6d1c7537 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:41.825555 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-4d86b8f0-62aa-47dc-9993-792a6d1c7537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:41.847602 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 404/803] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:41 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:41.898062 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 400/804] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:41 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 14:54:42.176605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae0b45-2e26-4aee-a586-e5a648c6276e None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:42.221398 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:42.227672 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86b8f0-62aa-47dc-9993-792a6d1c7537 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:42.277169 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae0b45-2e26-4aee-a586-e5a648c6276e None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:42.286262 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:42.310992 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558df5a-acce-4136-9263-8840d46489d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:42.311603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558df5a-acce-4136-9263-8840d46489d8 None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:42.311882 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558df5a-acce-4136-9263-8840d46489d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:42.312148 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558df5a-acce-4136-9263-8840d46489d8 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:42.312796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558df5a-acce-4136-9263-8840d46489d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:42.314149 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558df5a-acce-4136-9263-8840d46489d8 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:42.327545 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86b8f0-62aa-47dc-9993-792a6d1c7537 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:42.361939 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e423789-b9c4-4caf-a814-54c22400c708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:42.362578 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e423789-b9c4-4caf-a814-54c22400c708 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:42.362859 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e423789-b9c4-4caf-a814-54c22400c708 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:42.363136 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e423789-b9c4-4caf-a814-54c22400c708 None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:42.363765 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e423789-b9c4-4caf-a814-54c22400c708 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:42.365185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e423789-b9c4-4caf-a814-54c22400c708 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:42.365859 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 405/805] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 31 14:54:42 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:54:42.367781 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: WARNING keystone.server.flask.common [None req-1e423789-b9c4-4caf-a814-54c22400c708 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 14:54:42.406189 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.sql.core [None req-1e423789-b9c4-4caf-a814-54c22400c708 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 14:54:42.406189 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 14:54:42.406189 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [parameters: {'user_id': 'bf0ddbcfbd5943ab9456ce38baa08ac3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 14:54:42.406189 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88468) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-1e423789-b9c4-4caf-a814-54c22400c708 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application conn.query(q) Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application result.read() Aug 31 14:54:42.423315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 14:54:42.424925 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application next(self.gen) Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application yield resource Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application next(self.gen) Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise self.value Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application session.commit() Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 14:54:42.425934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self.session.flush() Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application compat.raise_( Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 14:54:42.426997 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 14:54:42.427905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application conn.query(q) Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application result.read() Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 14:54:42.428794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bf0ddbcfbd5943ab9456ce38baa08ac3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:42.430185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 14:54:42.431461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 14:54:42.432614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 14:54:42.432614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 14:54:42.432614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 14:54:42.432614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 14:54:42.432614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 14:54:42.432614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:42.432614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 401/806] 10.222.0.52 () {60 vars in 1131 bytes} [Wed Aug 31 14:54:42 2022] POST /identity/v3/users => generated 160 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:54:42.434263 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558df5a-acce-4136-9263-8840d46489d8 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:42.544307 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:42.548984 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558df5a-acce-4136-9263-8840d46489d8 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:42.584361 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7afeb-0726-42c6-a873-65e52437947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:42.585000 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7afeb-0726-42c6-a873-65e52437947e None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:42.585284 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7afeb-0726-42c6-a873-65e52437947e None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:42.585558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7afeb-0726-42c6-a873-65e52437947e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:42.593037 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7afeb-0726-42c6-a873-65e52437947e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:42.595091 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7afeb-0726-42c6-a873-65e52437947e None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-bcb7afeb-0726-42c6-a873-65e52437947e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:54:42.606742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:42.607870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:42.609190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:42.609190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:42.609190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:54:42.609190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:54:42.609190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:54:42.609190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:54:42.609190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:54:42.609190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:54:42.609190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 14:54:42.609190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:42.609190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 406/807] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:54:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:42.614157 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e423789-b9c4-4caf-a814-54c22400c708 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:42.715558 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e423789-b9c4-4caf-a814-54c22400c708 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:42.735252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:42.749504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86002e85-d8f1-4ccd-9f71-ad77a9c74203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:42.750106 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002e85-d8f1-4ccd-9f71-ad77a9c74203 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:42.750552 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002e85-d8f1-4ccd-9f71-ad77a9c74203 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:42.750879 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002e85-d8f1-4ccd-9f71-ad77a9c74203 None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:42.751649 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86002e85-d8f1-4ccd-9f71-ad77a9c74203 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:42.751956 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86002e85-d8f1-4ccd-9f71-ad77a9c74203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:42.753720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86002e85-d8f1-4ccd-9f71-ad77a9c74203 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:42.793479 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 402/808] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 31 14:54:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:44.549942 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1ad17-36cb-480a-ba91-9d15fd52283f None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:44.550507 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1ad17-36cb-480a-ba91-9d15fd52283f None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:44.550618 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1ad17-36cb-480a-ba91-9d15fd52283f None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:44.551882 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 407/809] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:44.558060 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85856ef-612d-4f3c-a40a-cfc62eb69891 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:44.558521 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85856ef-612d-4f3c-a40a-cfc62eb69891 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:44.558653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85856ef-612d-4f3c-a40a-cfc62eb69891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:44.576791 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-d85856ef-612d-4f3c-a40a-cfc62eb69891 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:44.578334 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-d85856ef-612d-4f3c-a40a-cfc62eb69891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:44.643987 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 403/810] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:44 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:44.977291 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1ad17-36cb-480a-ba91-9d15fd52283f None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:45.079156 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1ad17-36cb-480a-ba91-9d15fd52283f None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:45.112588 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3efd-e0dc-4ecb-a84c-e6d48ebb7857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:45.113186 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3efd-e0dc-4ecb-a84c-e6d48ebb7857 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:45.113466 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3efd-e0dc-4ecb-a84c-e6d48ebb7857 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:45.113739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3efd-e0dc-4ecb-a84c-e6d48ebb7857 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:45.114339 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c3efd-e0dc-4ecb-a84c-e6d48ebb7857 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:45.115689 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c3efd-e0dc-4ecb-a84c-e6d48ebb7857 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-614c3efd-e0dc-4ecb-a84c-e6d48ebb7857 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:45.124826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:45.125898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:54:45.127138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 408/811] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:45.131866 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85856ef-612d-4f3c-a40a-cfc62eb69891 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:45.230748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85856ef-612d-4f3c-a40a-cfc62eb69891 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:45.239882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:45.264748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be9fb4-4e48-422e-814b-5147c3f8e9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:45.265340 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be9fb4-4e48-422e-814b-5147c3f8e9d1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:45.265619 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be9fb4-4e48-422e-814b-5147c3f8e9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:45.265890 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be9fb4-4e48-422e-814b-5147c3f8e9d1 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:45.266539 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be9fb4-4e48-422e-814b-5147c3f8e9d1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:45.266846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be9fb4-4e48-422e-814b-5147c3f8e9d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:45.268202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be9fb4-4e48-422e-814b-5147c3f8e9d1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:45.274251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 404/812] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:45.279586 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3efd-e0dc-4ecb-a84c-e6d48ebb7857 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:45.304257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:45.376473 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3efd-e0dc-4ecb-a84c-e6d48ebb7857 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:45.408654 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835caf10-8386-4485-b5e2-63cb782ba7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:45.409234 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835caf10-8386-4485-b5e2-63cb782ba7b6 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:45.409510 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835caf10-8386-4485-b5e2-63cb782ba7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:45.409774 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835caf10-8386-4485-b5e2-63cb782ba7b6 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:45.410416 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835caf10-8386-4485-b5e2-63cb782ba7b6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:45.410714 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835caf10-8386-4485-b5e2-63cb782ba7b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:45.412049 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835caf10-8386-4485-b5e2-63cb782ba7b6 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:45.417317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 409/813] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:54:45.423359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be9fb4-4e48-422e-814b-5147c3f8e9d1 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:45.519452 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be9fb4-4e48-422e-814b-5147c3f8e9d1 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:45.555693 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929459c7-f2e1-4f58-8bb6-809d3aa171df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:45.556280 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929459c7-f2e1-4f58-8bb6-809d3aa171df None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:45.556557 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929459c7-f2e1-4f58-8bb6-809d3aa171df None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:45.556824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929459c7-f2e1-4f58-8bb6-809d3aa171df None admin] PATH_INFO: `/v3/endpoints` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:45.557511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929459c7-f2e1-4f58-8bb6-809d3aa171df None admin] RBAC: Adding query filter params (interface=public, service_id=7a35dcdffd3649aba3a9da7d86d071ca, region_id=RegionOne) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:45.557813 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929459c7-f2e1-4f58-8bb6-809d3aa171df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:45.559190 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929459c7-f2e1-4f58-8bb6-809d3aa171df None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:45.563983 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 405/814] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 31 14:54:45 2022] GET /identity/v3/endpoints?service_id=7a35dcdffd3649aba3a9da7d86d071ca&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:45.569608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835caf10-8386-4485-b5e2-63cb782ba7b6 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:45.656213 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:45.668451 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835caf10-8386-4485-b5e2-63cb782ba7b6 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:45.701212 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18077642-a441-400d-8d57-76f0210f5964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:45.701832 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18077642-a441-400d-8d57-76f0210f5964 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:45.702115 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18077642-a441-400d-8d57-76f0210f5964 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:45.702421 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18077642-a441-400d-8d57-76f0210f5964 None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:45.703027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18077642-a441-400d-8d57-76f0210f5964 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:45.704408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18077642-a441-400d-8d57-76f0210f5964 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:45.711001 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 410/815] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 31 14:54:45 2022] GET /identity/v3/services => generated 1728 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 14:54:47.905230 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f027d5-d05f-4d69-af04-ebddfa57c7dc None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:47.905698 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f027d5-d05f-4d69-af04-ebddfa57c7dc None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:47.905781 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f027d5-d05f-4d69-af04-ebddfa57c7dc None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:47.907132 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 406/816] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:54:47.912164 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657e2b3-8d12-4277-81fc-086163f734f8 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:47.912593 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657e2b3-8d12-4277-81fc-086163f734f8 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:47.912686 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657e2b3-8d12-4277-81fc-086163f734f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:47.931479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-8657e2b3-8d12-4277-81fc-086163f734f8 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:54:47.932650 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-8657e2b3-8d12-4277-81fc-086163f734f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:54:47.997262 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 411/817] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:54:47 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:54:48.336165 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f027d5-d05f-4d69-af04-ebddfa57c7dc None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:48.372859 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:48.437034 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f027d5-d05f-4d69-af04-ebddfa57c7dc None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:48.469888 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3057a1-5f50-42bd-a875-12daa3b772b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:48.470518 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3057a1-5f50-42bd-a875-12daa3b772b5 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:48.470799 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3057a1-5f50-42bd-a875-12daa3b772b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:48.471066 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3057a1-5f50-42bd-a875-12daa3b772b5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:48.471635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3057a1-5f50-42bd-a875-12daa3b772b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:48.472999 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3057a1-5f50-42bd-a875-12daa3b772b5 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-9b3057a1-5f50-42bd-a875-12daa3b772b5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:54:48.483270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:54:48.484221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:54:48.485058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 407/818] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:54:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:54:48.490506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657e2b3-8d12-4277-81fc-086163f734f8 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:48.570213 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:48.594841 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657e2b3-8d12-4277-81fc-086163f734f8 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:48.622640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c63102-d845-47fc-98db-35e22929766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:48.623235 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c63102-d845-47fc-98db-35e22929766b None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:48.623510 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c63102-d845-47fc-98db-35e22929766b None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:48.623777 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c63102-d845-47fc-98db-35e22929766b None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:48.624401 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c63102-d845-47fc-98db-35e22929766b None admin] RBAC: Adding query filter params (name=compute) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:48.624698 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c63102-d845-47fc-98db-35e22929766b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:48.626028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c63102-d845-47fc-98db-35e22929766b None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:48.630573 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 412/819] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:48.636622 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3057a1-5f50-42bd-a875-12daa3b772b5 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:48.733232 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:48.736200 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3057a1-5f50-42bd-a875-12daa3b772b5 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:48.769393 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0b700-8da1-4687-9901-ab6ff3068c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:48.769983 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0b700-8da1-4687-9901-ab6ff3068c7b None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:48.770388 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0b700-8da1-4687-9901-ab6ff3068c7b None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:48.770891 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0b700-8da1-4687-9901-ab6ff3068c7b None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:48.771685 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0b700-8da1-4687-9901-ab6ff3068c7b None admin] RBAC: Adding query filter params (type=compute) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:54:48.772295 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0b700-8da1-4687-9901-ab6ff3068c7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:48.774676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0b700-8da1-4687-9901-ab6ff3068c7b None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:48.779314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 408/820] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 31 14:54:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:54:48.785396 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c63102-d845-47fc-98db-35e22929766b None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:54:48.884265 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c63102-d845-47fc-98db-35e22929766b None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:54:48.917393 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa75801-060b-4417-be4d-f290fe4ee465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:54:48.917980 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa75801-060b-4417-be4d-f290fe4ee465 None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:54:48.918255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa75801-060b-4417-be4d-f290fe4ee465 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:54:48.918553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa75801-060b-4417-be4d-f290fe4ee465 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:54:48.919218 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa75801-060b-4417-be4d-f290fe4ee465 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:54:48.920549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa75801-060b-4417-be4d-f290fe4ee465 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:54:48.994139 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 413/821] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 31 14:54:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:54:58.776982 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=18 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:54:58.989943 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:07.317636 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd14d1-0e7c-4a52-86dd-409d6435d8c9 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:07.318227 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd14d1-0e7c-4a52-86dd-409d6435d8c9 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:07.318227 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd14d1-0e7c-4a52-86dd-409d6435d8c9 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:07.319594 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 409/822] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:56:07.324742 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b756c0-aef9-41f4-9b3e-068315a5a7bc None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:07.325176 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b756c0-aef9-41f4-9b3e-068315a5a7bc None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:07.325284 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b756c0-aef9-41f4-9b3e-068315a5a7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:07.343551 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-e5b756c0-aef9-41f4-9b3e-068315a5a7bc None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:56:07.344722 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-e5b756c0-aef9-41f4-9b3e-068315a5a7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:56:07.415720 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 414/823] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:56:07 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:56:07.746142 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd14d1-0e7c-4a52-86dd-409d6435d8c9 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:07.852072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd14d1-0e7c-4a52-86dd-409d6435d8c9 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:07.886194 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a09e8f-2bf2-409e-b78f-4f0438fe075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:07.886864 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a09e8f-2bf2-409e-b78f-4f0438fe075c None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:07.887189 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a09e8f-2bf2-409e-b78f-4f0438fe075c None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:07.887447 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a09e8f-2bf2-409e-b78f-4f0438fe075c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:07.897941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a09e8f-2bf2-409e-b78f-4f0438fe075c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:07.899432 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a09e8f-2bf2-409e-b78f-4f0438fe075c None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-91a09e8f-2bf2-409e-b78f-4f0438fe075c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:07.914496 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:07.915680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:07.917129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:07.917129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:07.917129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:07.917129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 410/824] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:07.921833 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b756c0-aef9-41f4-9b3e-068315a5a7bc None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:08.021854 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b756c0-aef9-41f4-9b3e-068315a5a7bc None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:08.047471 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:08.056713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b06646-3b68-4b9c-8299-16ab18300985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:08.057369 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b06646-3b68-4b9c-8299-16ab18300985 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:08.057648 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b06646-3b68-4b9c-8299-16ab18300985 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:08.057919 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b06646-3b68-4b9c-8299-16ab18300985 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:08.058591 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b06646-3b68-4b9c-8299-16ab18300985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:08.058891 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b06646-3b68-4b9c-8299-16ab18300985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:08.060243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b06646-3b68-4b9c-8299-16ab18300985 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:08.071434 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 415/825] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:08.077379 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a09e8f-2bf2-409e-b78f-4f0438fe075c None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:08.130774 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:08.176955 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a09e8f-2bf2-409e-b78f-4f0438fe075c None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:08.209307 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4112b14-a89e-4ea0-971f-e91354302d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:08.209894 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4112b14-a89e-4ea0-971f-e91354302d3c None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:08.210171 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4112b14-a89e-4ea0-971f-e91354302d3c None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:08.210477 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4112b14-a89e-4ea0-971f-e91354302d3c None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:08.211106 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4112b14-a89e-4ea0-971f-e91354302d3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:08.212523 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4112b14-a89e-4ea0-971f-e91354302d3c None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:08.337295 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 411/826] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 31 14:56:08 2022] POST /identity/v3/users => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 14:56:10.550960 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2904fbc-3d25-4de1-844c-32e951d13a37 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:10.551536 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2904fbc-3d25-4de1-844c-32e951d13a37 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:10.551536 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2904fbc-3d25-4de1-844c-32e951d13a37 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:10.552963 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 416/827] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:56:10.559186 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2573fb0-d062-47c4-a6c1-cb881058cba5 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:10.559640 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2573fb0-d062-47c4-a6c1-cb881058cba5 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:10.559771 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2573fb0-d062-47c4-a6c1-cb881058cba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:10.578011 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-f2573fb0-d062-47c4-a6c1-cb881058cba5 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:56:10.580586 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-f2573fb0-d062-47c4-a6c1-cb881058cba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:56:10.646890 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 412/828] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:56:10 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:56:10.969641 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2904fbc-3d25-4de1-844c-32e951d13a37 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:11.070713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2904fbc-3d25-4de1-844c-32e951d13a37 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:11.103459 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5350dda-e40d-465c-83da-7cea8216fa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:11.104046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5350dda-e40d-465c-83da-7cea8216fa72 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:11.104345 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5350dda-e40d-465c-83da-7cea8216fa72 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:11.104613 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5350dda-e40d-465c-83da-7cea8216fa72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:11.115291 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5350dda-e40d-465c-83da-7cea8216fa72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-a5350dda-e40d-465c-83da-7cea8216fa72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:56:11.120064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:11.121163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:11.122432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 417/829] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:56:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:11.127770 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2573fb0-d062-47c4-a6c1-cb881058cba5 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:11.166919 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:11.225285 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2573fb0-d062-47c4-a6c1-cb881058cba5 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:11.258893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1b106-5735-41d8-98d6-c3e3db423c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:11.259492 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1b106-5735-41d8-98d6-c3e3db423c50 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:11.259767 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1b106-5735-41d8-98d6-c3e3db423c50 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:11.260035 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1b106-5735-41d8-98d6-c3e3db423c50 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:11.260688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1b106-5735-41d8-98d6-c3e3db423c50 None admin] RBAC: Adding query filter params (name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:11.260985 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1b106-5735-41d8-98d6-c3e3db423c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:11.262434 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1b106-5735-41d8-98d6-c3e3db423c50 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:11.270652 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 413/830] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:56:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:11.276745 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5350dda-e40d-465c-83da-7cea8216fa72 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:11.323060 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:11.375214 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5350dda-e40d-465c-83da-7cea8216fa72 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:11.408705 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2823f0-0d1f-4802-aef3-3e264db5eb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:11.409329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2823f0-0d1f-4802-aef3-3e264db5eb97 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:11.409613 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2823f0-0d1f-4802-aef3-3e264db5eb97 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:11.409952 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2823f0-0d1f-4802-aef3-3e264db5eb97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:11.420563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2823f0-0d1f-4802-aef3-3e264db5eb97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:11.423837 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2823f0-0d1f-4802-aef3-3e264db5eb97 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-ac2823f0-0d1f-4802-aef3-3e264db5eb97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:11.451506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:11.452663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:11.453743 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:11.453743 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:11.453743 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:11.453743 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 418/831] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:56:11.459114 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1b106-5735-41d8-98d6-c3e3db423c50 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:11.566333 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:11.569355 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1b106-5735-41d8-98d6-c3e3db423c50 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:11.602560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2edc8a-fbc4-411f-9c7c-0784ec6bfddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:11.603159 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2edc8a-fbc4-411f-9c7c-0784ec6bfddd None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:11.603437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2edc8a-fbc4-411f-9c7c-0784ec6bfddd None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:11.603705 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2edc8a-fbc4-411f-9c7c-0784ec6bfddd None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:11.604406 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2edc8a-fbc4-411f-9c7c-0784ec6bfddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:11.604643 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2edc8a-fbc4-411f-9c7c-0784ec6bfddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:11.605993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2edc8a-fbc4-411f-9c7c-0784ec6bfddd None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:11.617948 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 414/832] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:11.624269 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2823f0-0d1f-4802-aef3-3e264db5eb97 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:11.723201 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:11.726674 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2823f0-0d1f-4802-aef3-3e264db5eb97 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:11.774311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d985-6eea-4cb3-ac90-b46919c1e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:11.774938 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d985-6eea-4cb3-ac90-b46919c1e1b0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:11.775211 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d985-6eea-4cb3-ac90-b46919c1e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:11.775477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d985-6eea-4cb3-ac90-b46919c1e1b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:11.783192 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8d985-6eea-4cb3-ac90-b46919c1e1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:11.787361 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8d985-6eea-4cb3-ac90-b46919c1e1b0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-7eb8d985-6eea-4cb3-ac90-b46919c1e1b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:56:11.795272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:11.796480 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:11.797634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:11.797634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:11.797634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:56:11.797634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:56:11.797634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:56:11.797634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:56:11.797634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:56:11.797634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:56:11.797634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 14:56:11.797634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:11.797634 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 419/833] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:11.803100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2edc8a-fbc4-411f-9c7c-0784ec6bfddd None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:11.905246 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2edc8a-fbc4-411f-9c7c-0784ec6bfddd None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:11.939288 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340661e-9ef8-4aa2-8ace-6b6abbefa973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:11.939908 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340661e-9ef8-4aa2-8ace-6b6abbefa973 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:11.940167 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340661e-9ef8-4aa2-8ace-6b6abbefa973 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:11.940444 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340661e-9ef8-4aa2-8ace-6b6abbefa973 None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:11.941195 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340661e-9ef8-4aa2-8ace-6b6abbefa973 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:11.941607 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340661e-9ef8-4aa2-8ace-6b6abbefa973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:11.943097 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340661e-9ef8-4aa2-8ace-6b6abbefa973 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:11.959979 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 415/834] 10.222.0.52 () {56 vars in 1143 bytes} [Wed Aug 31 14:56:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:11.965901 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d985-6eea-4cb3-ac90-b46919c1e1b0 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:12.070810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d985-6eea-4cb3-ac90-b46919c1e1b0 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:12.103674 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb47ef1-2db7-4593-8f5d-793573712bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:12.104266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb47ef1-2db7-4593-8f5d-793573712bef None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:12.104541 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb47ef1-2db7-4593-8f5d-793573712bef None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:12.104811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb47ef1-2db7-4593-8f5d-793573712bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:12.131335 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:12.171168 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb47ef1-2db7-4593-8f5d-793573712bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:12.172580 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb47ef1-2db7-4593-8f5d-793573712bef None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:12.270644 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 420/835] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:56:11 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 14:56:12.276379 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340661e-9ef8-4aa2-8ace-6b6abbefa973 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:12.297184 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:12.381714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340661e-9ef8-4aa2-8ace-6b6abbefa973 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:12.417831 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f3ada-b59e-4c49-bb0b-624f2971fbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:12.418489 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f3ada-b59e-4c49-bb0b-624f2971fbbc None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:12.418769 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f3ada-b59e-4c49-bb0b-624f2971fbbc None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:12.419096 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f3ada-b59e-4c49-bb0b-624f2971fbbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:12.429205 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f3ada-b59e-4c49-bb0b-624f2971fbbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:12.430832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f3ada-b59e-4c49-bb0b-624f2971fbbc None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-924f3ada-b59e-4c49-bb0b-624f2971fbbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:12.445644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:12.446871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:12.448237 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:12.448237 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:12.448237 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:12.448237 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 416/836] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:12.452676 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb47ef1-2db7-4593-8f5d-793573712bef None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:12.512364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:12.554962 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb47ef1-2db7-4593-8f5d-793573712bef None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:12.590125 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa390ce-13f4-44f1-a4c2-c16c672e200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:12.590752 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa390ce-13f4-44f1-a4c2-c16c672e200f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:12.591035 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa390ce-13f4-44f1-a4c2-c16c672e200f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:12.591310 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa390ce-13f4-44f1-a4c2-c16c672e200f None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:12.591950 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa390ce-13f4-44f1-a4c2-c16c672e200f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:12.592253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa390ce-13f4-44f1-a4c2-c16c672e200f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:12.593740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa390ce-13f4-44f1-a4c2-c16c672e200f None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:12.605588 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 421/837] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:12.611899 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f3ada-b59e-4c49-bb0b-624f2971fbbc None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:12.686029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:12.718085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f3ada-b59e-4c49-bb0b-624f2971fbbc None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:12.750586 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afd411-2ae8-4e38-87f0-6a97d180c3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:12.751204 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afd411-2ae8-4e38-87f0-6a97d180c3e7 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:12.751504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afd411-2ae8-4e38-87f0-6a97d180c3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:12.751769 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afd411-2ae8-4e38-87f0-6a97d180c3e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:12.759407 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afd411-2ae8-4e38-87f0-6a97d180c3e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:12.760878 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afd411-2ae8-4e38-87f0-6a97d180c3e7 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-a0afd411-2ae8-4e38-87f0-6a97d180c3e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:56:12.772052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:12.773673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:12.774782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:56:12.774782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:56:12.774782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:56:12.774782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:56:12.774782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:56:12.774782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:56:12.774782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:56:12.774782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:12.774782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 417/838] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:56:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:56:12.779985 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa390ce-13f4-44f1-a4c2-c16c672e200f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:12.880564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa390ce-13f4-44f1-a4c2-c16c672e200f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:12.899151 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:12.915811 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfd545-92bd-42ea-9b79-d71c5c04c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:12.916417 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfd545-92bd-42ea-9b79-d71c5c04c5bb None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:12.916694 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfd545-92bd-42ea-9b79-d71c5c04c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:12.916965 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfd545-92bd-42ea-9b79-d71c5c04c5bb None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:12.917645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfd545-92bd-42ea-9b79-d71c5c04c5bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:12.917944 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfd545-92bd-42ea-9b79-d71c5c04c5bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:12.919471 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfd545-92bd-42ea-9b79-d71c5c04c5bb None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:12.932188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 422/839] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:56:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:12.938365 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afd411-2ae8-4e38-87f0-6a97d180c3e7 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:13.036639 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afd411-2ae8-4e38-87f0-6a97d180c3e7 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:13.063540 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:13.068878 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fe7bf-9ae8-49a6-97ed-6f6982c7736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:13.069987 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fe7bf-9ae8-49a6-97ed-6f6982c7736a None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:13.070258 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fe7bf-9ae8-49a6-97ed-6f6982c7736a None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:13.070564 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fe7bf-9ae8-49a6-97ed-6f6982c7736a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:13.071264 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fe7bf-9ae8-49a6-97ed-6f6982c7736a None admin] RBAC: Adding query filter params (role.id=6282183e8c2b48b499413483605de6fc, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=63cdd2ef65aa46fab70d0d09b7d7d17c) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:13.071565 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fe7bf-9ae8-49a6-97ed-6f6982c7736a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:13.073008 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fe7bf-9ae8-49a6-97ed-6f6982c7736a None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:13.078215 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 418/840] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:56:12 2022] GET /identity/v3/role_assignments?user.id=63cdd2ef65aa46fab70d0d09b7d7d17c&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=6282183e8c2b48b499413483605de6fc => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:15.241523 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531d580-f3eb-40f0-b66d-6b8a6d970c47 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:15.242146 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531d580-f3eb-40f0-b66d-6b8a6d970c47 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:15.242146 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531d580-f3eb-40f0-b66d-6b8a6d970c47 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:15.243512 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 423/841] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:56:15.248699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafed00-3dcb-47c2-a418-c63d2d21895d None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:15.249116 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafed00-3dcb-47c2-a418-c63d2d21895d None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:15.249246 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafed00-3dcb-47c2-a418-c63d2d21895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:15.267593 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-4bafed00-3dcb-47c2-a418-c63d2d21895d None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:56:15.268787 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-4bafed00-3dcb-47c2-a418-c63d2d21895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:56:15.337721 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 419/842] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:56:15 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 14:56:15.666019 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531d580-f3eb-40f0-b66d-6b8a6d970c47 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:15.768373 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531d580-f3eb-40f0-b66d-6b8a6d970c47 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:15.802156 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b76ce5-178d-45d2-a2d8-57fd702f2e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:15.802934 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b76ce5-178d-45d2-a2d8-57fd702f2e37 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:15.803209 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b76ce5-178d-45d2-a2d8-57fd702f2e37 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:15.803476 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b76ce5-178d-45d2-a2d8-57fd702f2e37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:15.815202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b76ce5-178d-45d2-a2d8-57fd702f2e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-93b76ce5-178d-45d2-a2d8-57fd702f2e37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:56:15.820935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:15.822013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:15.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 424/843] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:56:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:15.828280 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafed00-3dcb-47c2-a418-c63d2d21895d None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:15.928497 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafed00-3dcb-47c2-a418-c63d2d21895d None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:15.952144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:15.962635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775f663-4df6-4d44-bb69-0652e1309d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:15.963239 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775f663-4df6-4d44-bb69-0652e1309d4f None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:15.963521 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775f663-4df6-4d44-bb69-0652e1309d4f None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:15.963796 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775f663-4df6-4d44-bb69-0652e1309d4f None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:15.964481 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775f663-4df6-4d44-bb69-0652e1309d4f None admin] RBAC: Adding query filter params (name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:15.964825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775f663-4df6-4d44-bb69-0652e1309d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:15.966220 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775f663-4df6-4d44-bb69-0652e1309d4f None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:15.974028 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 420/844] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:56:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:15.980124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b76ce5-178d-45d2-a2d8-57fd702f2e37 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:16.021472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:16.094240 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b76ce5-178d-45d2-a2d8-57fd702f2e37 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:16.134944 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c6265-c10f-41f7-8912-040ee4063512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:16.135777 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c6265-c10f-41f7-8912-040ee4063512 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:16.136221 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c6265-c10f-41f7-8912-040ee4063512 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:16.136656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c6265-c10f-41f7-8912-040ee4063512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:16.148623 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c6265-c10f-41f7-8912-040ee4063512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:16.150593 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c6265-c10f-41f7-8912-040ee4063512 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-d85c6265-c10f-41f7-8912-040ee4063512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:16.170847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:16.172152 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:16.173286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:16.173286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:16.173286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:16.173286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 425/845] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:16.179283 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775f663-4df6-4d44-bb69-0652e1309d4f None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:16.281336 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775f663-4df6-4d44-bb69-0652e1309d4f None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:16.315506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59baa-ca2f-44bc-b3d6-72ac3d8b16ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:16.316103 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59baa-ca2f-44bc-b3d6-72ac3d8b16ae None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:16.316382 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59baa-ca2f-44bc-b3d6-72ac3d8b16ae None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:16.316655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59baa-ca2f-44bc-b3d6-72ac3d8b16ae None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:16.317286 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a59baa-ca2f-44bc-b3d6-72ac3d8b16ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:16.317624 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a59baa-ca2f-44bc-b3d6-72ac3d8b16ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:16.319020 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a59baa-ca2f-44bc-b3d6-72ac3d8b16ae None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:16.330564 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 421/846] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:16.336936 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c6265-c10f-41f7-8912-040ee4063512 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:16.430828 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:16.439324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c6265-c10f-41f7-8912-040ee4063512 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:16.472843 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f75d2-b576-4ba8-bbd9-2daccbda100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:16.473550 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f75d2-b576-4ba8-bbd9-2daccbda100d None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:16.474931 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f75d2-b576-4ba8-bbd9-2daccbda100d None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:16.475211 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f75d2-b576-4ba8-bbd9-2daccbda100d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:16.483764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f75d2-b576-4ba8-bbd9-2daccbda100d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:16.485200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f75d2-b576-4ba8-bbd9-2daccbda100d None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-d23f75d2-b576-4ba8-bbd9-2daccbda100d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:56:16.498255 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:16.499406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:16.500606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:16.500606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:16.500606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:56:16.500606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:56:16.500606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:56:16.500606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:56:16.500606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:56:16.500606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:56:16.500606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 14:56:16.500606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:16.500606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 426/847] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:16.507824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59baa-ca2f-44bc-b3d6-72ac3d8b16ae None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:16.560691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:16.615051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59baa-ca2f-44bc-b3d6-72ac3d8b16ae None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:16.650613 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74072132-3148-47a3-8d21-26f3311b85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:16.651212 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74072132-3148-47a3-8d21-26f3311b85bb None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:16.651488 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74072132-3148-47a3-8d21-26f3311b85bb None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:16.651756 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74072132-3148-47a3-8d21-26f3311b85bb None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:16.652469 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74072132-3148-47a3-8d21-26f3311b85bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:16.652768 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74072132-3148-47a3-8d21-26f3311b85bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:16.654349 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74072132-3148-47a3-8d21-26f3311b85bb None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:16.672809 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 422/848] 10.222.0.52 () {56 vars in 1143 bytes} [Wed Aug 31 14:56:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:16.679086 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f75d2-b576-4ba8-bbd9-2daccbda100d None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:16.786463 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f75d2-b576-4ba8-bbd9-2daccbda100d None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:16.820863 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ce887-6369-4fdf-b925-873bf4160b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:16.821491 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ce887-6369-4fdf-b925-873bf4160b84 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:16.821767 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ce887-6369-4fdf-b925-873bf4160b84 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:16.822034 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ce887-6369-4fdf-b925-873bf4160b84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:16.833007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ce887-6369-4fdf-b925-873bf4160b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:16.837147 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ce887-6369-4fdf-b925-873bf4160b84 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-233ce887-6369-4fdf-b925-873bf4160b84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:16.849881 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:16.851780 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:16.852899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:16.852899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:16.852899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:16.852899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 427/849] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:16.857695 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74072132-3148-47a3-8d21-26f3311b85bb None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:16.957125 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74072132-3148-47a3-8d21-26f3311b85bb None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:16.959439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:16.990240 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60131fad-2d50-478e-976c-54bcd731d887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:16.990979 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60131fad-2d50-478e-976c-54bcd731d887 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:16.991419 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60131fad-2d50-478e-976c-54bcd731d887 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:16.991721 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60131fad-2d50-478e-976c-54bcd731d887 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:16.992359 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60131fad-2d50-478e-976c-54bcd731d887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:16.992663 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60131fad-2d50-478e-976c-54bcd731d887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:16.994058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60131fad-2d50-478e-976c-54bcd731d887 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:17.005266 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 423/850] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:17.012489 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ce887-6369-4fdf-b925-873bf4160b84 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:17.015399 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:17.114064 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ce887-6369-4fdf-b925-873bf4160b84 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:17.147075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970e233-0333-4ba6-9acd-b59a055cfd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:17.148377 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970e233-0333-4ba6-9acd-b59a055cfd0f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:17.148655 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970e233-0333-4ba6-9acd-b59a055cfd0f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:17.148925 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970e233-0333-4ba6-9acd-b59a055cfd0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:17.155270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970e233-0333-4ba6-9acd-b59a055cfd0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:17.156682 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970e233-0333-4ba6-9acd-b59a055cfd0f None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-6970e233-0333-4ba6-9acd-b59a055cfd0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:56:17.167558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:17.168413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:17.169353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:56:17.169353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:56:17.169353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:56:17.169353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:56:17.169353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:56:17.169353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:56:17.169353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:56:17.169353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:17.169353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 428/851] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:56:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:56:17.174513 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60131fad-2d50-478e-976c-54bcd731d887 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:17.282243 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60131fad-2d50-478e-976c-54bcd731d887 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:17.316188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a657e1-bb4d-49d4-b7f1-f39df938e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:17.316793 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a657e1-bb4d-49d4-b7f1-f39df938e6ae None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:17.317091 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a657e1-bb4d-49d4-b7f1-f39df938e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:17.318415 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a657e1-bb4d-49d4-b7f1-f39df938e6ae None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:17.318415 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a657e1-bb4d-49d4-b7f1-f39df938e6ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:17.318415 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a657e1-bb4d-49d4-b7f1-f39df938e6ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:17.320605 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a657e1-bb4d-49d4-b7f1-f39df938e6ae None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:17.332792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 424/852] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:56:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:17.338968 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970e233-0333-4ba6-9acd-b59a055cfd0f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:17.406158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:17.445939 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970e233-0333-4ba6-9acd-b59a055cfd0f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:17.479647 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20289ec-1169-433e-b4ac-84f751ca6ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:17.480306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20289ec-1169-433e-b4ac-84f751ca6ee7 None admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:17.480581 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20289ec-1169-433e-b4ac-84f751ca6ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:17.480932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20289ec-1169-433e-b4ac-84f751ca6ee7 None admin] PATH_INFO: `/v3/projects/cac45966110b47f28339c78e693b3793/users/63cdd2ef65aa46fab70d0d09b7d7d17c/roles/6282183e8c2b48b499413483605de6fc` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:17.495945 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20289ec-1169-433e-b4ac-84f751ca6ee7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cac45966110b47f28339c78e693b3793, user_id=63cdd2ef65aa46fab70d0d09b7d7d17c, role_id=6282183e8c2b48b499413483605de6fc)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:17.497375 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20289ec-1169-433e-b4ac-84f751ca6ee7 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:17.607133 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 429/853] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:56:17 2022] PUT /identity/v3/projects/cac45966110b47f28339c78e693b3793/users/63cdd2ef65aa46fab70d0d09b7d7d17c/roles/6282183e8c2b48b499413483605de6fc => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:56:19.793411 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e2d4d-b42d-4bee-b964-27deee9bac4c None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:19.793968 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e2d4d-b42d-4bee-b964-27deee9bac4c None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:19.793968 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e2d4d-b42d-4bee-b964-27deee9bac4c None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:19.795328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 425/854] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:56:19.800354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01a3bc-f4f9-4104-ae0b-a8d11f52146f None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:19.800770 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01a3bc-f4f9-4104-ae0b-a8d11f52146f None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:19.800877 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01a3bc-f4f9-4104-ae0b-a8d11f52146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:19.818791 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-4d01a3bc-f4f9-4104-ae0b-a8d11f52146f None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:56:19.820026 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-4d01a3bc-f4f9-4104-ae0b-a8d11f52146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:56:19.887067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 430/855] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:56:19 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:56:20.214670 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e2d4d-b42d-4bee-b964-27deee9bac4c None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:20.240184 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:20.318922 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e2d4d-b42d-4bee-b964-27deee9bac4c None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:20.354339 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11bd9f-dbc1-426f-a9a0-699faf8cf5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:20.354961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11bd9f-dbc1-426f-a9a0-699faf8cf5dc None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:20.355237 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11bd9f-dbc1-426f-a9a0-699faf8cf5dc None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:20.355503 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11bd9f-dbc1-426f-a9a0-699faf8cf5dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:20.367203 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11bd9f-dbc1-426f-a9a0-699faf8cf5dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-ba11bd9f-dbc1-426f-a9a0-699faf8cf5dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:56:20.372024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:20.372927 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:20.373806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 426/856] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 31 14:56:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:20.379472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01a3bc-f4f9-4104-ae0b-a8d11f52146f None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:20.421909 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:20.478644 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01a3bc-f4f9-4104-ae0b-a8d11f52146f None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:20.513444 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffbe3-1c08-46b1-998f-62b9498dd65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:20.514041 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffbe3-1c08-46b1-998f-62b9498dd65f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:20.514341 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffbe3-1c08-46b1-998f-62b9498dd65f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:20.514653 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffbe3-1c08-46b1-998f-62b9498dd65f None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:20.515306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ffbe3-1c08-46b1-998f-62b9498dd65f None admin] RBAC: Adding query filter params (name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:20.515606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ffbe3-1c08-46b1-998f-62b9498dd65f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:20.517039 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ffbe3-1c08-46b1-998f-62b9498dd65f None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:20.525174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 431/857] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 31 14:56:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:20.531532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11bd9f-dbc1-426f-a9a0-699faf8cf5dc None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:20.618266 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:20.634504 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11bd9f-dbc1-426f-a9a0-699faf8cf5dc None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:20.670069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118bef-789b-41ba-8eb7-457305aa789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:20.670744 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118bef-789b-41ba-8eb7-457305aa789d None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:20.671021 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118bef-789b-41ba-8eb7-457305aa789d None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:20.671287 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118bef-789b-41ba-8eb7-457305aa789d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:20.682143 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb118bef-789b-41ba-8eb7-457305aa789d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:20.683609 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb118bef-789b-41ba-8eb7-457305aa789d None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-fb118bef-789b-41ba-8eb7-457305aa789d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:20.697633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:20.698835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:20.699892 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:20.699892 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:20.699892 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:20.699892 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 427/858] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:20.705307 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffbe3-1c08-46b1-998f-62b9498dd65f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:20.807715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffbe3-1c08-46b1-998f-62b9498dd65f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:20.809901 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:20.840463 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a3456-2079-45a2-b733-ee6d1750c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:20.841059 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a3456-2079-45a2-b733-ee6d1750c1b0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:20.841337 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a3456-2079-45a2-b733-ee6d1750c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:20.841602 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a3456-2079-45a2-b733-ee6d1750c1b0 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:20.842285 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a3456-2079-45a2-b733-ee6d1750c1b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:20.842609 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a3456-2079-45a2-b733-ee6d1750c1b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:20.843950 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a3456-2079-45a2-b733-ee6d1750c1b0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:20.855696 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 432/859] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:20.861949 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118bef-789b-41ba-8eb7-457305aa789d None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:20.962935 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118bef-789b-41ba-8eb7-457305aa789d None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:20.996821 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f94f3-8f4f-43b7-b366-cb2a10a2f75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:20.997437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f94f3-8f4f-43b7-b366-cb2a10a2f75a None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:20.997754 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f94f3-8f4f-43b7-b366-cb2a10a2f75a None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:20.998025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f94f3-8f4f-43b7-b366-cb2a10a2f75a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:21.000739 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:21.005741 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f94f3-8f4f-43b7-b366-cb2a10a2f75a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:21.007270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f94f3-8f4f-43b7-b366-cb2a10a2f75a None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-b07f94f3-8f4f-43b7-b366-cb2a10a2f75a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:56:21.018122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:21.019252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:21.020576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:21.020576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:21.020576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:56:21.020576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:56:21.020576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:56:21.020576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:56:21.020576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:56:21.020576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:56:21.020576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 14:56:21.020576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:21.020576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 428/860] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:21.025628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a3456-2079-45a2-b733-ee6d1750c1b0 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:21.127754 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a3456-2079-45a2-b733-ee6d1750c1b0 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:21.162177 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee009d-aba7-410a-9cba-2f85bf81f23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:21.162808 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee009d-aba7-410a-9cba-2f85bf81f23c None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:21.164116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee009d-aba7-410a-9cba-2f85bf81f23c None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:21.164398 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee009d-aba7-410a-9cba-2f85bf81f23c None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:21.165256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee009d-aba7-410a-9cba-2f85bf81f23c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:21.165563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee009d-aba7-410a-9cba-2f85bf81f23c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:21.167007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee009d-aba7-410a-9cba-2f85bf81f23c None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:21.184592 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 433/861] 10.222.0.52 () {56 vars in 1143 bytes} [Wed Aug 31 14:56:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:21.190528 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f94f3-8f4f-43b7-b366-cb2a10a2f75a None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:21.291641 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f94f3-8f4f-43b7-b366-cb2a10a2f75a None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:21.324610 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ab5a2-d9d2-4ba2-9f2f-5c42d69f72ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:21.325208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab5a2-d9d2-4ba2-9f2f-5c42d69f72ec None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:21.325488 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab5a2-d9d2-4ba2-9f2f-5c42d69f72ec None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:21.325760 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab5a2-d9d2-4ba2-9f2f-5c42d69f72ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:21.386847 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:21.393432 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ab5a2-d9d2-4ba2-9f2f-5c42d69f72ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:21.394969 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ab5a2-d9d2-4ba2-9f2f-5c42d69f72ec None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:21.491635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 429/862] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:56:21 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 14:56:21.497454 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee009d-aba7-410a-9cba-2f85bf81f23c None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:21.521993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:21.597188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee009d-aba7-410a-9cba-2f85bf81f23c None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:21.632418 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dca4d4-1c98-4894-a91b-3ef8491d1044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:21.633049 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dca4d4-1c98-4894-a91b-3ef8491d1044 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:21.633327 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dca4d4-1c98-4894-a91b-3ef8491d1044 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:21.633598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dca4d4-1c98-4894-a91b-3ef8491d1044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:21.643690 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dca4d4-1c98-4894-a91b-3ef8491d1044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:21.645133 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dca4d4-1c98-4894-a91b-3ef8491d1044 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-a4dca4d4-1c98-4894-a91b-3ef8491d1044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:21.660329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:21.664202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:21.665279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:21.665279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:21.665279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:21.665279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 434/863] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:21.667336 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ab5a2-d9d2-4ba2-9f2f-5c42d69f72ec None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:21.761031 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:21.766793 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ab5a2-d9d2-4ba2-9f2f-5c42d69f72ec None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:21.801240 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dbda7-5ad8-4c23-af60-772d6604c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:21.801838 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dbda7-5ad8-4c23-af60-772d6604c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:21.802117 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dbda7-5ad8-4c23-af60-772d6604c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:21.802422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dbda7-5ad8-4c23-af60-772d6604c1f4 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:21.803060 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dbda7-5ad8-4c23-af60-772d6604c1f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:21.803361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dbda7-5ad8-4c23-af60-772d6604c1f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:21.805361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dbda7-5ad8-4c23-af60-772d6604c1f4 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:21.816409 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 430/864] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:21.822661 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dca4d4-1c98-4894-a91b-3ef8491d1044 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:21.899590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:21.923659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dca4d4-1c98-4894-a91b-3ef8491d1044 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:21.958633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9bf7-5b6a-424a-824e-42f459ba06d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:21.959279 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9bf7-5b6a-424a-824e-42f459ba06d0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:21.959542 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9bf7-5b6a-424a-824e-42f459ba06d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:21.960350 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9bf7-5b6a-424a-824e-42f459ba06d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:21.966907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac9bf7-5b6a-424a-824e-42f459ba06d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:21.968403 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac9bf7-5b6a-424a-824e-42f459ba06d0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-e6ac9bf7-5b6a-424a-824e-42f459ba06d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:56:21.980363 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:21.986479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:21.987564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:56:21.987564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:56:21.987564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:56:21.987564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:56:21.987564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:56:21.987564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:56:21.987564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:56:21.987564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:21.987564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 435/865] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:56:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:21.988150 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dbda7-5ad8-4c23-af60-772d6604c1f4 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:22.087873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dbda7-5ad8-4c23-af60-772d6604c1f4 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:22.121209 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b95c6-2a3a-422c-9f8e-fa6ff9bfaa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:22.121800 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b95c6-2a3a-422c-9f8e-fa6ff9bfaa69 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:22.122077 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b95c6-2a3a-422c-9f8e-fa6ff9bfaa69 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:22.122381 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b95c6-2a3a-422c-9f8e-fa6ff9bfaa69 None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:22.123062 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b95c6-2a3a-422c-9f8e-fa6ff9bfaa69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:22.123362 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b95c6-2a3a-422c-9f8e-fa6ff9bfaa69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:22.124832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b95c6-2a3a-422c-9f8e-fa6ff9bfaa69 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:22.136694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 431/866] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:56:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:22.142722 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9bf7-5b6a-424a-824e-42f459ba06d0 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:22.242983 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9bf7-5b6a-424a-824e-42f459ba06d0 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:22.277189 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a1547-3217-4b55-b05a-ec3095ea7ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:22.277835 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a1547-3217-4b55-b05a-ec3095ea7ac0 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:22.278157 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a1547-3217-4b55-b05a-ec3095ea7ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:22.278455 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a1547-3217-4b55-b05a-ec3095ea7ac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:22.279174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a1547-3217-4b55-b05a-ec3095ea7ac0 None admin] RBAC: Adding query filter params (role.id=6282183e8c2b48b499413483605de6fc, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=63cdd2ef65aa46fab70d0d09b7d7d17c) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:22.279479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a1547-3217-4b55-b05a-ec3095ea7ac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:22.280885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a1547-3217-4b55-b05a-ec3095ea7ac0 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:22.282802 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:22.287218 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 436/867] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:56:22 2022] GET /identity/v3/role_assignments?user.id=63cdd2ef65aa46fab70d0d09b7d7d17c&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=6282183e8c2b48b499413483605de6fc => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:24.518320 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822bc0-0709-4175-a12d-77c64e72ddc9 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:24.518866 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822bc0-0709-4175-a12d-77c64e72ddc9 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:24.518866 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822bc0-0709-4175-a12d-77c64e72ddc9 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:24.520187 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 432/868] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:56:24.526317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb66f8-0a5b-4a6f-ba6a-3ebc44c06dd7 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:24.526749 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb66f8-0a5b-4a6f-ba6a-3ebc44c06dd7 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:24.526879 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb66f8-0a5b-4a6f-ba6a-3ebc44c06dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:24.544892 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-bafb66f8-0a5b-4a6f-ba6a-3ebc44c06dd7 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:56:24.546091 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-bafb66f8-0a5b-4a6f-ba6a-3ebc44c06dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:56:24.613722 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 437/869] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:56:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:56:24.953281 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89822bc0-0709-4175-a12d-77c64e72ddc9 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:24.971818 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:25.056821 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89822bc0-0709-4175-a12d-77c64e72ddc9 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:25.091263 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f64cb1-f121-4e16-9816-f885c4dc89c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:25.091889 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f64cb1-f121-4e16-9816-f885c4dc89c2 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:25.092169 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f64cb1-f121-4e16-9816-f885c4dc89c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:25.092443 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f64cb1-f121-4e16-9816-f885c4dc89c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:25.103277 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f64cb1-f121-4e16-9816-f885c4dc89c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-99f64cb1-f121-4e16-9816-f885c4dc89c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:56:25.108247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:25.109323 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:25.111720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 433/870] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:56:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:25.115405 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb66f8-0a5b-4a6f-ba6a-3ebc44c06dd7 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:25.228783 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb66f8-0a5b-4a6f-ba6a-3ebc44c06dd7 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:25.254919 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:25.263506 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5088756-10d6-4fd3-abd4-2d9d39883d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:25.264109 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5088756-10d6-4fd3-abd4-2d9d39883d47 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:25.264387 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5088756-10d6-4fd3-abd4-2d9d39883d47 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:25.264658 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5088756-10d6-4fd3-abd4-2d9d39883d47 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:25.265310 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5088756-10d6-4fd3-abd4-2d9d39883d47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:25.265610 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5088756-10d6-4fd3-abd4-2d9d39883d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:25.266996 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5088756-10d6-4fd3-abd4-2d9d39883d47 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:25.275936 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 438/871] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:56:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:25.281876 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f64cb1-f121-4e16-9816-f885c4dc89c2 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:25.358463 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:25.380289 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f64cb1-f121-4e16-9816-f885c4dc89c2 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:25.415994 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da927e-3e03-4394-9989-452095474894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:25.416556 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da927e-3e03-4394-9989-452095474894 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:25.416832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da927e-3e03-4394-9989-452095474894 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:25.417101 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da927e-3e03-4394-9989-452095474894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:25.426885 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da927e-3e03-4394-9989-452095474894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:25.428485 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da927e-3e03-4394-9989-452095474894 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-84da927e-3e03-4394-9989-452095474894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:25.442729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:25.443825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:25.445308 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:25.445308 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:25.445308 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:25.445308 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 434/872] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:25.450829 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5088756-10d6-4fd3-abd4-2d9d39883d47 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:25.551253 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5088756-10d6-4fd3-abd4-2d9d39883d47 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:25.585703 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e589ed-fb58-4003-8c60-b0e18ada7cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:25.586311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e589ed-fb58-4003-8c60-b0e18ada7cf7 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:25.586622 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e589ed-fb58-4003-8c60-b0e18ada7cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:25.586876 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e589ed-fb58-4003-8c60-b0e18ada7cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:25.587508 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e589ed-fb58-4003-8c60-b0e18ada7cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:25.587804 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e589ed-fb58-4003-8c60-b0e18ada7cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:25.589143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e589ed-fb58-4003-8c60-b0e18ada7cf7 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:25.600458 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 439/873] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:25.606478 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da927e-3e03-4394-9989-452095474894 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:25.708429 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da927e-3e03-4394-9989-452095474894 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:25.734834 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:25.743247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0ba47-8737-4f2c-878e-86d792060d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:25.743863 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0ba47-8737-4f2c-878e-86d792060d27 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:25.744168 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0ba47-8737-4f2c-878e-86d792060d27 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:25.744413 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0ba47-8737-4f2c-878e-86d792060d27 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:25.751565 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0ba47-8737-4f2c-878e-86d792060d27 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:25.752974 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0ba47-8737-4f2c-878e-86d792060d27 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-95f0ba47-8737-4f2c-878e-86d792060d27 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:56:25.764731 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:25.765846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:25.767188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:25.767188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:25.767188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:56:25.767188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:56:25.767188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:56:25.767188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:56:25.767188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:56:25.767188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:56:25.767188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 14:56:25.767188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:25.767188 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 435/874] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:25.771600 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e589ed-fb58-4003-8c60-b0e18ada7cf7 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:25.821583 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:25.870610 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e589ed-fb58-4003-8c60-b0e18ada7cf7 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:25.904275 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db2b11-1a99-49ba-9ccb-a1e3390da768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:25.904876 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db2b11-1a99-49ba-9ccb-a1e3390da768 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:25.905154 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db2b11-1a99-49ba-9ccb-a1e3390da768 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:25.905424 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db2b11-1a99-49ba-9ccb-a1e3390da768 None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:25.907673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db2b11-1a99-49ba-9ccb-a1e3390da768 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:25.907673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db2b11-1a99-49ba-9ccb-a1e3390da768 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:25.907939 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db2b11-1a99-49ba-9ccb-a1e3390da768 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:25.925137 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 440/875] 10.222.0.52 () {56 vars in 1143 bytes} [Wed Aug 31 14:56:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:25.931597 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0ba47-8737-4f2c-878e-86d792060d27 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:26.031035 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0ba47-8737-4f2c-878e-86d792060d27 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:26.065190 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb91c68-609f-4187-ac53-693c3b49699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:26.065814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb91c68-609f-4187-ac53-693c3b49699a None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:26.066105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb91c68-609f-4187-ac53-693c3b49699a None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:26.066396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb91c68-609f-4187-ac53-693c3b49699a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:26.121653 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:26.133830 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb91c68-609f-4187-ac53-693c3b49699a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:26.135337 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb91c68-609f-4187-ac53-693c3b49699a None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:26.232121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 436/876] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:56:25 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 14:56:26.238200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db2b11-1a99-49ba-9ccb-a1e3390da768 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:26.338137 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db2b11-1a99-49ba-9ccb-a1e3390da768 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:26.347566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:26.372213 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2694f-e3e9-4967-9e9f-ff68bbd98917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:26.372831 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2694f-e3e9-4967-9e9f-ff68bbd98917 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:26.373107 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2694f-e3e9-4967-9e9f-ff68bbd98917 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:26.373374 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2694f-e3e9-4967-9e9f-ff68bbd98917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:26.383008 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2694f-e3e9-4967-9e9f-ff68bbd98917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:26.384422 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2694f-e3e9-4967-9e9f-ff68bbd98917 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-42f2694f-e3e9-4967-9e9f-ff68bbd98917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:26.399563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:26.400747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:26.401684 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:26.401684 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:26.401684 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:26.401684 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 441/877] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:26.406541 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb91c68-609f-4187-ac53-693c3b49699a None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:26.495041 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:26.507297 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb91c68-609f-4187-ac53-693c3b49699a None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:26.539897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eddc4b-edba-4708-b154-b511580fc1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:26.540502 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eddc4b-edba-4708-b154-b511580fc1fc None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:26.540832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eddc4b-edba-4708-b154-b511580fc1fc None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:26.541106 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eddc4b-edba-4708-b154-b511580fc1fc None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:26.541749 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eddc4b-edba-4708-b154-b511580fc1fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:26.542075 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eddc4b-edba-4708-b154-b511580fc1fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:26.543491 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eddc4b-edba-4708-b154-b511580fc1fc None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:26.555136 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 437/878] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:26.560862 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2694f-e3e9-4967-9e9f-ff68bbd98917 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:26.660895 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2694f-e3e9-4967-9e9f-ff68bbd98917 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:26.694510 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3822a-2c93-4be8-b31a-c97c1f7d0f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:26.695183 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3822a-2c93-4be8-b31a-c97c1f7d0f20 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:26.695463 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3822a-2c93-4be8-b31a-c97c1f7d0f20 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:26.695783 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3822a-2c93-4be8-b31a-c97c1f7d0f20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:26.702239 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3822a-2c93-4be8-b31a-c97c1f7d0f20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:26.703697 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3822a-2c93-4be8-b31a-c97c1f7d0f20 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-6df3822a-2c93-4be8-b31a-c97c1f7d0f20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:56:26.714933 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:26.715929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:26.717270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:56:26.717270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:56:26.717270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:56:26.717270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:56:26.717270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:56:26.717270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:56:26.717270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:56:26.717270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:26.717270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 442/879] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:56:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:26.721832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eddc4b-edba-4708-b154-b511580fc1fc None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:26.823569 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eddc4b-edba-4708-b154-b511580fc1fc None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:26.858638 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e1290-fe41-4fa7-8093-d0388dd782f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:26.859240 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e1290-fe41-4fa7-8093-d0388dd782f1 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:26.859517 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e1290-fe41-4fa7-8093-d0388dd782f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:26.859786 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e1290-fe41-4fa7-8093-d0388dd782f1 None admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:26.860462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e1290-fe41-4fa7-8093-d0388dd782f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:26.860764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e1290-fe41-4fa7-8093-d0388dd782f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:26.862256 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e1290-fe41-4fa7-8093-d0388dd782f1 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:26.874854 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 438/880] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:56:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:26.880848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3822a-2c93-4be8-b31a-c97c1f7d0f20 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:26.902845 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:26.979611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3822a-2c93-4be8-b31a-c97c1f7d0f20 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:27.013424 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51bc46-c992-4692-b2cc-a2a3aa43081d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:27.014016 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51bc46-c992-4692-b2cc-a2a3aa43081d None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:27.014354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51bc46-c992-4692-b2cc-a2a3aa43081d None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:27.014718 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51bc46-c992-4692-b2cc-a2a3aa43081d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:27.015434 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51bc46-c992-4692-b2cc-a2a3aa43081d None admin] RBAC: Adding query filter params (role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=63cdd2ef65aa46fab70d0d09b7d7d17c) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:27.015736 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51bc46-c992-4692-b2cc-a2a3aa43081d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:27.017188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51bc46-c992-4692-b2cc-a2a3aa43081d None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:27.023179 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 443/881] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:56:26 2022] GET /identity/v3/role_assignments?user.id=63cdd2ef65aa46fab70d0d09b7d7d17c&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:29.182585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c56fcf-3dcf-4a6b-af52-31b1c481f360 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:29.183132 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c56fcf-3dcf-4a6b-af52-31b1c481f360 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:29.183132 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c56fcf-3dcf-4a6b-af52-31b1c481f360 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:29.184456 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 439/882] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:56:29.189788 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015b71a-9920-42ea-9358-14d7729e9672 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:29.190199 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015b71a-9920-42ea-9358-14d7729e9672 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:29.192225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015b71a-9920-42ea-9358-14d7729e9672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:29.208850 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-e015b71a-9920-42ea-9358-14d7729e9672 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:56:29.210662 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-e015b71a-9920-42ea-9358-14d7729e9672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:56:29.277817 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 444/883] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:56:29 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:56:29.606848 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c56fcf-3dcf-4a6b-af52-31b1c481f360 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:29.618932 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:29.715551 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c56fcf-3dcf-4a6b-af52-31b1c481f360 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:29.752184 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31b428-96f6-4029-8e27-e231800fe7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:29.752934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31b428-96f6-4029-8e27-e231800fe7ce None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:29.753211 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31b428-96f6-4029-8e27-e231800fe7ce None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:29.753481 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31b428-96f6-4029-8e27-e231800fe7ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:29.763893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31b428-96f6-4029-8e27-e231800fe7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-3e31b428-96f6-4029-8e27-e231800fe7ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:56:29.769010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:29.770233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:29.771526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 440/884] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:56:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:29.776855 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015b71a-9920-42ea-9358-14d7729e9672 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:29.793014 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:29.877609 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015b71a-9920-42ea-9358-14d7729e9672 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:29.911993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3680c49-db81-4249-92e7-a29a89c8a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:29.913135 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3680c49-db81-4249-92e7-a29a89c8a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:29.913549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3680c49-db81-4249-92e7-a29a89c8a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:29.914013 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3680c49-db81-4249-92e7-a29a89c8a6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:29.915244 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3680c49-db81-4249-92e7-a29a89c8a6a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:29.915758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3680c49-db81-4249-92e7-a29a89c8a6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:29.917395 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3680c49-db81-4249-92e7-a29a89c8a6a3 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:29.926970 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 445/885] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:56:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:56:29.933845 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31b428-96f6-4029-8e27-e231800fe7ce None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:30.002429 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:30.035185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31b428-96f6-4029-8e27-e231800fe7ce None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:30.068288 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877b9e5-eb55-417e-96d7-8d7f61aa6c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:30.068899 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877b9e5-eb55-417e-96d7-8d7f61aa6c73 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:30.069345 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877b9e5-eb55-417e-96d7-8d7f61aa6c73 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:30.069794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877b9e5-eb55-417e-96d7-8d7f61aa6c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:30.079909 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877b9e5-eb55-417e-96d7-8d7f61aa6c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:30.081946 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877b9e5-eb55-417e-96d7-8d7f61aa6c73 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-f877b9e5-eb55-417e-96d7-8d7f61aa6c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:30.096807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:30.097934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:30.099078 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:30.099078 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:30.099078 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:30.099078 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 441/886] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:30.104905 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3680c49-db81-4249-92e7-a29a89c8a6a3 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:30.183926 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:30.210432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3680c49-db81-4249-92e7-a29a89c8a6a3 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:30.247519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170dd9-6aa0-4834-b538-b62e609506a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:30.248115 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170dd9-6aa0-4834-b538-b62e609506a5 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:30.248392 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170dd9-6aa0-4834-b538-b62e609506a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:30.248661 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170dd9-6aa0-4834-b538-b62e609506a5 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:30.249289 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170dd9-6aa0-4834-b538-b62e609506a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:30.249586 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170dd9-6aa0-4834-b538-b62e609506a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:30.250971 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170dd9-6aa0-4834-b538-b62e609506a5 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:30.263575 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 446/887] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:30.269584 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877b9e5-eb55-417e-96d7-8d7f61aa6c73 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:30.386041 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877b9e5-eb55-417e-96d7-8d7f61aa6c73 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:30.409809 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:30.425280 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe866452-77e3-4e12-8640-6e3e198df575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:30.425963 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe866452-77e3-4e12-8640-6e3e198df575 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:30.426243 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe866452-77e3-4e12-8640-6e3e198df575 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:30.426612 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe866452-77e3-4e12-8640-6e3e198df575 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:30.435459 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe866452-77e3-4e12-8640-6e3e198df575 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:30.436970 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe866452-77e3-4e12-8640-6e3e198df575 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-fe866452-77e3-4e12-8640-6e3e198df575 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:56:30.450602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:30.456591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:30.457844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:30.457844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:30.457844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:56:30.457844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:56:30.457844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:56:30.457844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:56:30.457844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:56:30.457844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:56:30.457844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 14:56:30.457844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:30.457844 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 442/888] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:30.458865 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170dd9-6aa0-4834-b538-b62e609506a5 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:30.567885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170dd9-6aa0-4834-b538-b62e609506a5 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:30.613485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5750e22-bb24-4f45-9c03-baebdd0e3c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:30.614127 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5750e22-bb24-4f45-9c03-baebdd0e3c43 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:30.614459 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5750e22-bb24-4f45-9c03-baebdd0e3c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:30.614737 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5750e22-bb24-4f45-9c03-baebdd0e3c43 None admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:30.615593 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5750e22-bb24-4f45-9c03-baebdd0e3c43 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:30.616774 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5750e22-bb24-4f45-9c03-baebdd0e3c43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:30.618692 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5750e22-bb24-4f45-9c03-baebdd0e3c43 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:30.622132 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:30.646306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 447/889] 10.222.0.52 () {56 vars in 1143 bytes} [Wed Aug 31 14:56:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:30.652847 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe866452-77e3-4e12-8640-6e3e198df575 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:30.775144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe866452-77e3-4e12-8640-6e3e198df575 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:30.815617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e34f51-b19a-4e25-a9a0-f2988c8bd5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:30.816241 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e34f51-b19a-4e25-a9a0-f2988c8bd5ce None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:30.816527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e34f51-b19a-4e25-a9a0-f2988c8bd5ce None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:30.816800 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e34f51-b19a-4e25-a9a0-f2988c8bd5ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:30.835728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e34f51-b19a-4e25-a9a0-f2988c8bd5ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:30.836948 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e34f51-b19a-4e25-a9a0-f2988c8bd5ce None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-d1e34f51-b19a-4e25-a9a0-f2988c8bd5ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:30.856560 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:30.858532 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:30.860388 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:30.860388 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:30.860388 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:30.860388 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 443/890] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:30.865493 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5750e22-bb24-4f45-9c03-baebdd0e3c43 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:30.976248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5750e22-bb24-4f45-9c03-baebdd0e3c43 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:31.013404 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa32319-0bfe-4d4d-88a2-c6c5a410a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:31.014018 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa32319-0bfe-4d4d-88a2-c6c5a410a6fd None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:31.014327 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa32319-0bfe-4d4d-88a2-c6c5a410a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:31.014599 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa32319-0bfe-4d4d-88a2-c6c5a410a6fd None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:31.015248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa32319-0bfe-4d4d-88a2-c6c5a410a6fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:31.015551 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa32319-0bfe-4d4d-88a2-c6c5a410a6fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:31.016956 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa32319-0bfe-4d4d-88a2-c6c5a410a6fd None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:31.029352 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 448/891] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:31.035036 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e34f51-b19a-4e25-a9a0-f2988c8bd5ce None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:31.067205 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:31.148022 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e34f51-b19a-4e25-a9a0-f2988c8bd5ce None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:31.187573 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab4f44-5dd4-49d5-8d76-6f72c50cb7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:31.188190 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4f44-5dd4-49d5-8d76-6f72c50cb7a4 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:31.188468 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4f44-5dd4-49d5-8d76-6f72c50cb7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:31.188736 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4f44-5dd4-49d5-8d76-6f72c50cb7a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:31.195851 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab4f44-5dd4-49d5-8d76-6f72c50cb7a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:31.198093 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab4f44-5dd4-49d5-8d76-6f72c50cb7a4 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-07ab4f44-5dd4-49d5-8d76-6f72c50cb7a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:56:31.208814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:31.210745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:31.212104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:56:31.212104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:56:31.212104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:56:31.212104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:56:31.212104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:56:31.212104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:56:31.212104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:56:31.212104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:31.212104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 444/892] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:56:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:31.216708 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa32319-0bfe-4d4d-88a2-c6c5a410a6fd None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:31.287251 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:31.333408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa32319-0bfe-4d4d-88a2-c6c5a410a6fd None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:31.388852 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245a418-d307-45e2-9d9f-4a59f47cf6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:31.389510 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245a418-d307-45e2-9d9f-4a59f47cf6c3 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:31.389794 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245a418-d307-45e2-9d9f-4a59f47cf6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:31.390070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245a418-d307-45e2-9d9f-4a59f47cf6c3 None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:31.390830 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245a418-d307-45e2-9d9f-4a59f47cf6c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:31.391134 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245a418-d307-45e2-9d9f-4a59f47cf6c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:31.392567 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245a418-d307-45e2-9d9f-4a59f47cf6c3 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:31.405377 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 449/893] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:56:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 14:56:31.414992 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab4f44-5dd4-49d5-8d76-6f72c50cb7a4 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:31.510143 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:31.518557 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab4f44-5dd4-49d5-8d76-6f72c50cb7a4 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:31.554631 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07808-8ebd-49b2-bc8a-ca9e20a26fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:31.555207 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07808-8ebd-49b2-bc8a-ca9e20a26fbb None admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:31.555488 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07808-8ebd-49b2-bc8a-ca9e20a26fbb None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:31.555762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07808-8ebd-49b2-bc8a-ca9e20a26fbb None admin] PATH_INFO: `/v3/projects/cac45966110b47f28339c78e693b3793/users/63cdd2ef65aa46fab70d0d09b7d7d17c/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:31.557672 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f07808-8ebd-49b2-bc8a-ca9e20a26fbb None admin] RBAC: Authorizing `identity:create_grant(project_id=cac45966110b47f28339c78e693b3793, user_id=63cdd2ef65aa46fab70d0d09b7d7d17c, role_id=7fe1d0d9f098408c9dc7ed9fca08a4a4)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:31.559205 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f07808-8ebd-49b2-bc8a-ca9e20a26fbb None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:31.617596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 445/894] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 31 14:56:31 2022] PUT /identity/v3/projects/cac45966110b47f28339c78e693b3793/users/63cdd2ef65aa46fab70d0d09b7d7d17c/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 14:56:33.909918 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f734c1-e70d-4969-aee8-59600f8f435f None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:33.910459 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f734c1-e70d-4969-aee8-59600f8f435f None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:33.910550 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f734c1-e70d-4969-aee8-59600f8f435f None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:33.911820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 450/895] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:56:33.917630 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b570ca-1c9c-4749-8514-2717feda1b25 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:33.918015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b570ca-1c9c-4749-8514-2717feda1b25 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:33.918174 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b570ca-1c9c-4749-8514-2717feda1b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:33.937969 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-b0b570ca-1c9c-4749-8514-2717feda1b25 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:56:33.939446 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-b0b570ca-1c9c-4749-8514-2717feda1b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:56:34.009550 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 446/896] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:56:33 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:56:34.346354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f734c1-e70d-4969-aee8-59600f8f435f None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:34.453860 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f734c1-e70d-4969-aee8-59600f8f435f None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:34.474759 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:34.497236 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed1111-4a9b-49bd-a0e7-a1557124daab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:34.497861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed1111-4a9b-49bd-a0e7-a1557124daab None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:34.498135 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed1111-4a9b-49bd-a0e7-a1557124daab None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:34.498441 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed1111-4a9b-49bd-a0e7-a1557124daab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:34.509362 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed1111-4a9b-49bd-a0e7-a1557124daab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-84ed1111-4a9b-49bd-a0e7-a1557124daab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 14:56:34.514632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:34.515758 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:34.516820 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 451/897] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 31 14:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 14:56:34.523573 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b570ca-1c9c-4749-8514-2717feda1b25 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:34.610204 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:34.629361 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b570ca-1c9c-4749-8514-2717feda1b25 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:34.663586 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bec89-2b1c-4e4e-afa4-be8432752439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:34.664192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bec89-2b1c-4e4e-afa4-be8432752439 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:34.664475 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bec89-2b1c-4e4e-afa4-be8432752439 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:34.664747 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bec89-2b1c-4e4e-afa4-be8432752439 None admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:34.665403 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bec89-2b1c-4e4e-afa4-be8432752439 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:34.665707 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bec89-2b1c-4e4e-afa4-be8432752439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:34.667128 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bec89-2b1c-4e4e-afa4-be8432752439 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:34.675139 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 447/898] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 31 14:56:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:34.682164 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed1111-4a9b-49bd-a0e7-a1557124daab None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:34.785746 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed1111-4a9b-49bd-a0e7-a1557124daab None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:34.822929 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20c457-e85b-4478-914b-ca7a44196512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:34.823553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20c457-e85b-4478-914b-ca7a44196512 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:34.823830 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20c457-e85b-4478-914b-ca7a44196512 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:34.824104 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20c457-e85b-4478-914b-ca7a44196512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:34.834460 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20c457-e85b-4478-914b-ca7a44196512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:34.835909 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20c457-e85b-4478-914b-ca7a44196512 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-da20c457-e85b-4478-914b-ca7a44196512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:34.851273 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:34.856355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:34.857713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:34.857713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:34.857713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:34.857713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 452/899] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:34.859460 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bec89-2b1c-4e4e-afa4-be8432752439 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:34.980678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bec89-2b1c-4e4e-afa4-be8432752439 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:35.018807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6fb3-115a-4a40-8617-8d79082e34d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:35.019468 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6fb3-115a-4a40-8617-8d79082e34d4 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:35.019753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6fb3-115a-4a40-8617-8d79082e34d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:35.020030 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6fb3-115a-4a40-8617-8d79082e34d4 None admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:35.020714 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f6fb3-115a-4a40-8617-8d79082e34d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:35.021017 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f6fb3-115a-4a40-8617-8d79082e34d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:35.022587 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f6fb3-115a-4a40-8617-8d79082e34d4 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:35.035823 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 448/900] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:35.043765 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20c457-e85b-4478-914b-ca7a44196512 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:35.076867 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:35.164799 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20c457-e85b-4478-914b-ca7a44196512 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:35.206188 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b6e85-f67f-4c9d-b06a-489c5ae93331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:35.206894 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b6e85-f67f-4c9d-b06a-489c5ae93331 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:35.207291 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b6e85-f67f-4c9d-b06a-489c5ae93331 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:35.207524 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b6e85-f67f-4c9d-b06a-489c5ae93331 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:35.216372 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b6e85-f67f-4c9d-b06a-489c5ae93331 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:35.218034 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b6e85-f67f-4c9d-b06a-489c5ae93331 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-164b6e85-f67f-4c9d-b06a-489c5ae93331 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 14:56:35.232673 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:35.233868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:35.234932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:35.234932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:35.234932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 14:56:35.234932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 14:56:35.234932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 14:56:35.234932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 14:56:35.234932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 14:56:35.234932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 14:56:35.234932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 14:56:35.234932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:35.234932 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 453/901] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:35.242371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6fb3-115a-4a40-8617-8d79082e34d4 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:35.246281 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:35.349840 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6fb3-115a-4a40-8617-8d79082e34d4 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:35.388086 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d6b53-a399-4bca-871f-7157be32814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:35.388684 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d6b53-a399-4bca-871f-7157be32814c None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:35.388962 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d6b53-a399-4bca-871f-7157be32814c None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:35.389231 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d6b53-a399-4bca-871f-7157be32814c None admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:35.389960 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d6b53-a399-4bca-871f-7157be32814c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:35.390264 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d6b53-a399-4bca-871f-7157be32814c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:35.391723 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d6b53-a399-4bca-871f-7157be32814c None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:35.415027 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 449/902] 10.222.0.52 () {56 vars in 1143 bytes} [Wed Aug 31 14:56:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:35.419824 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b6e85-f67f-4c9d-b06a-489c5ae93331 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:35.520130 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:35.535775 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b6e85-f67f-4c9d-b06a-489c5ae93331 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:35.573623 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30bf12-d42d-480c-992f-d8ec03924e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:35.574216 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30bf12-d42d-480c-992f-d8ec03924e8f None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:35.574518 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30bf12-d42d-480c-992f-d8ec03924e8f None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:35.574788 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30bf12-d42d-480c-992f-d8ec03924e8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:35.646046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30bf12-d42d-480c-992f-d8ec03924e8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:35.648304 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30bf12-d42d-480c-992f-d8ec03924e8f None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:35.739766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:35.755661 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 454/903] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 31 14:56:35 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 14:56:35.763041 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d6b53-a399-4bca-871f-7157be32814c None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:35.825596 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:35.865208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d6b53-a399-4bca-871f-7157be32814c None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:35.900721 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d10f2e-d3b2-4815-b88b-38e5bae635a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:35.901342 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d10f2e-d3b2-4815-b88b-38e5bae635a5 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:35.901622 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d10f2e-d3b2-4815-b88b-38e5bae635a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:35.901894 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d10f2e-d3b2-4815-b88b-38e5bae635a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:35.911668 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d10f2e-d3b2-4815-b88b-38e5bae635a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:35.913252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d10f2e-d3b2-4815-b88b-38e5bae635a5 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-30d10f2e-d3b2-4815-b88b-38e5bae635a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 14:56:35.927439 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:35.928699 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 14:56:35.929614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 14:56:35.929614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 14:56:35.929614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:35.929614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 450/904] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 14:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:35.934612 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30bf12-d42d-480c-992f-d8ec03924e8f None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:36.037274 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30bf12-d42d-480c-992f-d8ec03924e8f None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:36.071979 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d1cd0-98a7-4b77-9597-d9e8c529e834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:36.072628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d1cd0-98a7-4b77-9597-d9e8c529e834 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:36.072786 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d1cd0-98a7-4b77-9597-d9e8c529e834 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:36.073061 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d1cd0-98a7-4b77-9597-d9e8c529e834 None admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:36.073713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d1cd0-98a7-4b77-9597-d9e8c529e834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:36.074017 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d1cd0-98a7-4b77-9597-d9e8c529e834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:36.075420 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d1cd0-98a7-4b77-9597-d9e8c529e834 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:36.087292 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 455/905] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 31 14:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:36.093058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d10f2e-d3b2-4815-b88b-38e5bae635a5 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:36.195271 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d10f2e-d3b2-4815-b88b-38e5bae635a5 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:36.208763 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:36.229010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64e549-57fb-4096-b2ff-8cacf1ede0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:36.229635 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64e549-57fb-4096-b2ff-8cacf1ede0d6 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:36.229913 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64e549-57fb-4096-b2ff-8cacf1ede0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:36.230181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64e549-57fb-4096-b2ff-8cacf1ede0d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:36.237146 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64e549-57fb-4096-b2ff-8cacf1ede0d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:36.238615 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64e549-57fb-4096-b2ff-8cacf1ede0d6 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application [None req-7d64e549-57fb-4096-b2ff-8cacf1ede0d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 14:56:36.250728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:36.256044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:36.257759 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 14:56:36.257759 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 14:56:36.257759 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 14:56:36.257759 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 14:56:36.257759 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 14:56:36.257759 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 14:56:36.257759 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 14:56:36.257759 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: ERROR keystone.server.flask.application Aug 31 14:56:36.257759 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 451/906] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 31 14:56:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:36.259306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d1cd0-98a7-4b77-9597-d9e8c529e834 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:36.306882 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:36.360779 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d1cd0-98a7-4b77-9597-d9e8c529e834 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:36.395608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb16d-3e36-46b4-9486-99c9e3090475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:36.396207 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb16d-3e36-46b4-9486-99c9e3090475 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:36.396602 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb16d-3e36-46b4-9486-99c9e3090475 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:36.396880 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb16d-3e36-46b4-9486-99c9e3090475 None admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:36.397588 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb16d-3e36-46b4-9486-99c9e3090475 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:36.397888 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb16d-3e36-46b4-9486-99c9e3090475 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:36.399337 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb16d-3e36-46b4-9486-99c9e3090475 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:36.411353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 456/907] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 31 14:56:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:36.418304 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64e549-57fb-4096-b2ff-8cacf1ede0d6 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:36.522982 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64e549-57fb-4096-b2ff-8cacf1ede0d6 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:36.559998 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9ff3f-264c-4a1e-8b2f-d6ef650f149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:36.560588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9ff3f-264c-4a1e-8b2f-d6ef650f149c None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:36.560865 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9ff3f-264c-4a1e-8b2f-d6ef650f149c None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:36.561134 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9ff3f-264c-4a1e-8b2f-d6ef650f149c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:36.561841 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9ff3f-264c-4a1e-8b2f-d6ef650f149c None admin] RBAC: Adding query filter params (role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4, scope.project.id=cac45966110b47f28339c78e693b3793, user.id=63cdd2ef65aa46fab70d0d09b7d7d17c) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:36.562144 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9ff3f-264c-4a1e-8b2f-d6ef650f149c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:36.563623 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9ff3f-264c-4a1e-8b2f-d6ef650f149c None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:36.569341 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 452/908] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 31 14:56:36 2022] GET /identity/v3/role_assignments?user.id=63cdd2ef65aa46fab70d0d09b7d7d17c&scope.project.id=cac45966110b47f28339c78e693b3793&role.id=7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:38.971386 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f12f50-670a-43c6-a533-c48252cbabbb None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:38.972221 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f12f50-670a-43c6-a533-c48252cbabbb None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:38.972221 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f12f50-670a-43c6-a533-c48252cbabbb None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:38.973266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 457/909] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:56:38.979718 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2757c-7ec6-435a-a935-7676b652ce67 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:38.980156 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2757c-7ec6-435a-a935-7676b652ce67 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:38.980606 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2757c-7ec6-435a-a935-7676b652ce67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:39.004090 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-5be2757c-7ec6-435a-a935-7676b652ce67 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:56:39.005285 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-5be2757c-7ec6-435a-a935-7676b652ce67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:56:39.038695 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:39.084689 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 453/910] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:56:38 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:56:39.414819 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f12f50-670a-43c6-a533-c48252cbabbb None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:39.524192 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f12f50-670a-43c6-a533-c48252cbabbb None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:39.531334 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:39.558488 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0fc59-12a1-4466-bc69-54059fa42f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:39.559114 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0fc59-12a1-4466-bc69-54059fa42f18 None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:39.559402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0fc59-12a1-4466-bc69-54059fa42f18 None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:39.559664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0fc59-12a1-4466-bc69-54059fa42f18 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:39.560242 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0fc59-12a1-4466-bc69-54059fa42f18 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:39.561586 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0fc59-12a1-4466-bc69-54059fa42f18 None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-f7e0fc59-12a1-4466-bc69-54059fa42f18 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:39.570409 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:39.571669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:39.572571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 458/911] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 31 14:56:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:39.577745 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2757c-7ec6-435a-a935-7676b652ce67 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:39.677089 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2757c-7ec6-435a-a935-7676b652ce67 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:39.714036 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36634f46-060a-4864-897a-1a3342f023cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:39.714670 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36634f46-060a-4864-897a-1a3342f023cf None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:39.714949 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36634f46-060a-4864-897a-1a3342f023cf None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:39.715219 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36634f46-060a-4864-897a-1a3342f023cf None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:39.715838 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36634f46-060a-4864-897a-1a3342f023cf None admin] RBAC: Adding query filter params (name=placement) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:39.716135 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36634f46-060a-4864-897a-1a3342f023cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:39.717501 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36634f46-060a-4864-897a-1a3342f023cf None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:39.722365 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 454/912] 10.222.0.52 () {56 vars in 1116 bytes} [Wed Aug 31 14:56:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:39.728659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0fc59-12a1-4466-bc69-54059fa42f18 None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:39.829367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0fc59-12a1-4466-bc69-54059fa42f18 None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:39.864649 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc92539-a7ae-4ee6-9d9f-ae391a7a2b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:39.865256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92539-a7ae-4ee6-9d9f-ae391a7a2b0d None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:39.865530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92539-a7ae-4ee6-9d9f-ae391a7a2b0d None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:39.865800 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92539-a7ae-4ee6-9d9f-ae391a7a2b0d None admin] PATH_INFO: `/v3/services` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:39.866565 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92539-a7ae-4ee6-9d9f-ae391a7a2b0d None admin] RBAC: Adding query filter params (type=placement) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:39.866869 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92539-a7ae-4ee6-9d9f-ae391a7a2b0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:39.868219 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92539-a7ae-4ee6-9d9f-ae391a7a2b0d None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:39.872666 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 459/913] 10.222.0.52 () {56 vars in 1116 bytes} [Wed Aug 31 14:56:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:42.159868 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acd0c7-e1fc-4ec9-bf0c-28a308cc5670 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:42.160409 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acd0c7-e1fc-4ec9-bf0c-28a308cc5670 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:42.160409 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acd0c7-e1fc-4ec9-bf0c-28a308cc5670 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:42.161780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 455/914] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:56:42.168137 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa923f5-05f5-49e5-9fda-c669d18b2e37 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:42.168627 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa923f5-05f5-49e5-9fda-c669d18b2e37 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:42.168745 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa923f5-05f5-49e5-9fda-c669d18b2e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:42.186812 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-aaa923f5-05f5-49e5-9fda-c669d18b2e37 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:56:42.188027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-aaa923f5-05f5-49e5-9fda-c669d18b2e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:56:42.215573 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:42.255608 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 460/915] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:56:42 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:56:42.586195 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acd0c7-e1fc-4ec9-bf0c-28a308cc5670 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:42.617960 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:42.689995 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acd0c7-e1fc-4ec9-bf0c-28a308cc5670 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:42.725933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0841de-5649-46ca-9e5b-05631edbe6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:42.726556 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0841de-5649-46ca-9e5b-05631edbe6c5 None admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:42.726834 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0841de-5649-46ca-9e5b-05631edbe6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:42.727100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0841de-5649-46ca-9e5b-05631edbe6c5 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:42.727741 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0841de-5649-46ca-9e5b-05631edbe6c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:42.729181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0841de-5649-46ca-9e5b-05631edbe6c5 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:42.892797 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 456/916] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 31 14:56:42 2022] POST /identity/v3/services => generated 246 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:56:45.122903 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7fa80-0829-4191-99f5-630edc904662 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:45.123406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7fa80-0829-4191-99f5-630edc904662 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:45.123406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7fa80-0829-4191-99f5-630edc904662 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:45.124992 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 461/917] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:56:45.130207 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487a37-dcf7-4a17-9fb2-13ae5a5032d6 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:45.130676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487a37-dcf7-4a17-9fb2-13ae5a5032d6 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:45.130774 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487a37-dcf7-4a17-9fb2-13ae5a5032d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:45.149313 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-33487a37-dcf7-4a17-9fb2-13ae5a5032d6 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:56:45.150524 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-33487a37-dcf7-4a17-9fb2-13ae5a5032d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:56:45.223348 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 457/918] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:56:45 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:56:45.550582 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7fa80-0829-4191-99f5-630edc904662 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:45.654114 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7fa80-0829-4191-99f5-630edc904662 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:45.689089 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ec9cf-aa58-4591-976c-da247d5f7cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:45.689715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ec9cf-aa58-4591-976c-da247d5f7cba None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:45.690030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ec9cf-aa58-4591-976c-da247d5f7cba None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:45.690319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ec9cf-aa58-4591-976c-da247d5f7cba None admin] PATH_INFO: `/v3/services/placement` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:45.690907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ec9cf-aa58-4591-976c-da247d5f7cba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:45.692243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ec9cf-aa58-4591-976c-da247d5f7cba None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-980ec9cf-aa58-4591-976c-da247d5f7cba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:45.702075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:45.703298 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 14:56:45.704315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:45.706463 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 462/919] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 31 14:56:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:45.709331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33487a37-dcf7-4a17-9fb2-13ae5a5032d6 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:45.728236 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:45.809563 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33487a37-dcf7-4a17-9fb2-13ae5a5032d6 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:45.844759 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0d2fd-944c-4a0d-8702-a8604399bb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:45.844988 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0d2fd-944c-4a0d-8702-a8604399bb88 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:45.845261 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0d2fd-944c-4a0d-8702-a8604399bb88 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:45.845530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0d2fd-944c-4a0d-8702-a8604399bb88 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:45.846179 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0d2fd-944c-4a0d-8702-a8604399bb88 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:45.846485 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0d2fd-944c-4a0d-8702-a8604399bb88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:45.847942 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0d2fd-944c-4a0d-8702-a8604399bb88 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:45.853380 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 458/920] 10.222.0.52 () {56 vars in 1116 bytes} [Wed Aug 31 14:56:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:45.860087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ec9cf-aa58-4591-976c-da247d5f7cba None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:45.889436 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:45.960944 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ec9cf-aa58-4591-976c-da247d5f7cba None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:45.996896 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0d71a-87b3-416f-8bf5-ef170db9a5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:45.997502 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0d71a-87b3-416f-8bf5-ef170db9a5fa None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:45.997782 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0d71a-87b3-416f-8bf5-ef170db9a5fa None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:45.998087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0d71a-87b3-416f-8bf5-ef170db9a5fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:45.998808 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0d71a-87b3-416f-8bf5-ef170db9a5fa None admin] RBAC: Adding query filter params (interface=public, service_id=0bda2e8ac7004349bd97290608f92702, region_id=RegionOne) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:45.999121 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0d71a-87b3-416f-8bf5-ef170db9a5fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:46.000478 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0d71a-87b3-416f-8bf5-ef170db9a5fa None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:46.005567 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 463/921] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 31 14:56:45 2022] GET /identity/v3/endpoints?service_id=0bda2e8ac7004349bd97290608f92702&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:46.012047 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0d2fd-944c-4a0d-8702-a8604399bb88 None admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:46.092674 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:46.110117 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0d2fd-944c-4a0d-8702-a8604399bb88 None admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:46.143885 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63f341-2b63-41e6-896b-b2faee31e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:46.144527 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63f341-2b63-41e6-896b-b2faee31e5f2 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:46.144743 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63f341-2b63-41e6-896b-b2faee31e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:46.145011 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63f341-2b63-41e6-896b-b2faee31e5f2 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:46.145603 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63f341-2b63-41e6-896b-b2faee31e5f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:46.147072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63f341-2b63-41e6-896b-b2faee31e5f2 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:46.154645 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 459/922] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 31 14:56:46 2022] GET /identity/v3/services => generated 1962 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 14:56:48.372274 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef92722-5848-4331-82b9-d4e5fe977fd4 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:48.372809 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef92722-5848-4331-82b9-d4e5fe977fd4 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:48.372809 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef92722-5848-4331-82b9-d4e5fe977fd4 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:48.374138 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 464/923] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 14:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 14:56:48.379435 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d2589-1dcb-49a7-a06b-026c582c96d2 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:48.379934 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d2589-1dcb-49a7-a06b-026c582c96d2 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:48.380033 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d2589-1dcb-49a7-a06b-026c582c96d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:48.398613 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-ff8d2589-1dcb-49a7-a06b-026c582c96d2 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 14:56:48.404966 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-ff8d2589-1dcb-49a7-a06b-026c582c96d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 14:56:48.467287 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 460/924] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 14:56:48 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 14:56:48.796184 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef92722-5848-4331-82b9-d4e5fe977fd4 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:48.889672 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:48.899105 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef92722-5848-4331-82b9-d4e5fe977fd4 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:48.933536 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653db84-e2ef-487c-a94d-ad5b5ff0249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:48.934156 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653db84-e2ef-487c-a94d-ad5b5ff0249d None admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:48.934465 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653db84-e2ef-487c-a94d-ad5b5ff0249d None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:48.934734 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653db84-e2ef-487c-a94d-ad5b5ff0249d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:48.935309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653db84-e2ef-487c-a94d-ad5b5ff0249d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:48.936654 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653db84-e2ef-487c-a94d-ad5b5ff0249d None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application [None req-1653db84-e2ef-487c-a94d-ad5b5ff0249d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 14:56:48.945928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 14:56:48.951789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application with Lock( Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self._enter() Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application return self.creator() Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application created_value = creator( Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: ERROR keystone.server.flask.application Aug 31 14:56:48.952639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 465/925] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 31 14:56:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 14:56:48.953495 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d2589-1dcb-49a7-a06b-026c582c96d2 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:49.029855 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:49.051673 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d2589-1dcb-49a7-a06b-026c582c96d2 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:49.088637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cef44-007c-4460-83a6-117383f99677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:49.089271 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cef44-007c-4460-83a6-117383f99677 None admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:49.089748 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cef44-007c-4460-83a6-117383f99677 None admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:49.090175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cef44-007c-4460-83a6-117383f99677 None admin] PATH_INFO: `/v3/services` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:49.091233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cef44-007c-4460-83a6-117383f99677 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 14:56:49.091531 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cef44-007c-4460-83a6-117383f99677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:49.092897 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cef44-007c-4460-83a6-117383f99677 None admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:49.097882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 461/926] 10.222.0.52 () {56 vars in 1116 bytes} [Wed Aug 31 14:56:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 14:56:49.104338 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653db84-e2ef-487c-a94d-ad5b5ff0249d None admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 14:56:49.205580 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653db84-e2ef-487c-a94d-ad5b5ff0249d None admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 14:56:49.239859 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72353154-bcfb-479d-a6dc-d93dd01143ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 14:56:49.240465 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72353154-bcfb-479d-a6dc-d93dd01143ff None admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 14:56:49.241418 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72353154-bcfb-479d-a6dc-d93dd01143ff None admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 14:56:49.241692 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72353154-bcfb-479d-a6dc-d93dd01143ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 14:56:49.242385 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72353154-bcfb-479d-a6dc-d93dd01143ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 14:56:49.243744 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72353154-bcfb-479d-a6dc-d93dd01143ff None admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 14:56:49.331526 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 466/927] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 31 14:56:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 14:56:59.094975 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=30 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 14:56:59.326879 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:03:59.442636 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ffd0b-6c3a-4e11-a3ca-81ed4354fe80 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:03:59.443251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ffd0b-6c3a-4e11-a3ca-81ed4354fe80 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:03:59.443251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ffd0b-6c3a-4e11-a3ca-81ed4354fe80 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:03:59.445471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 462/928] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:03:59.450603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540c834-516b-48bc-9d6c-083f0a78191b None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:03:59.451059 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540c834-516b-48bc-9d6c-083f0a78191b None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:03:59.451140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540c834-516b-48bc-9d6c-083f0a78191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:03:59.577131 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-c540c834-516b-48bc-9d6c-083f0a78191b None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:03:59.577131 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-c540c834-516b-48bc-9d6c-083f0a78191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:03:59.706366 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 467/929] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:03:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:00.077712 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725742d-c8cd-457b-b096-3f8fc732768c None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:00.078078 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725742d-c8cd-457b-b096-3f8fc732768c None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:00.078879 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725742d-c8cd-457b-b096-3f8fc732768c None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:00.080332 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 463/930] 10.222.0.52 () {54 vars in 965 bytes} [Wed Aug 31 15:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:00.087797 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e162698-b789-4ed7-8069-3b356a482d50 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:00.088170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e162698-b789-4ed7-8069-3b356a482d50 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:00.088485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e162698-b789-4ed7-8069-3b356a482d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:00.147726 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-6e162698-b789-4ed7-8069-3b356a482d50 None None] MFA Rules not processed for user `5c3e43e391e1470e90b21511b98b0d40`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:00.148922 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-6e162698-b789-4ed7-8069-3b356a482d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:00.192754 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:04:00.234214 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 468/931] 10.222.0.52 () {58 vars in 1062 bytes} [Wed Aug 31 15:04:00 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:00.244500 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725742d-c8cd-457b-b096-3f8fc732768c None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:00.265056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725742d-c8cd-457b-b096-3f8fc732768c None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:00.269739 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80e95d-f86a-4a1a-af54-d29bf1245fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:00.270419 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80e95d-f86a-4a1a-af54-d29bf1245fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:00.278536 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80e95d-f86a-4a1a-af54-d29bf1245fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:00.278536 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80e95d-f86a-4a1a-af54-d29bf1245fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:00.281644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80e95d-f86a-4a1a-af54-d29bf1245fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:00.283794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80e95d-f86a-4a1a-af54-d29bf1245fc5 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:00.297469 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 464/932] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:04:02.823877 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ea645-8c30-4611-8796-1d09413e2276 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:02.824387 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ea645-8c30-4611-8796-1d09413e2276 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:02.824469 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ea645-8c30-4611-8796-1d09413e2276 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:02.825926 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 469/933] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:02.831495 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feeef2-847b-436c-81e6-14c2fbf3a3f9 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:02.831937 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feeef2-847b-436c-81e6-14c2fbf3a3f9 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:02.832043 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feeef2-847b-436c-81e6-14c2fbf3a3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:02.853126 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-28feeef2-847b-436c-81e6-14c2fbf3a3f9 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:02.854353 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-28feeef2-847b-436c-81e6-14c2fbf3a3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:02.866690 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 465/934] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:03.223671 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ab704-2174-4449-aae6-11f3450583a4 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:03.224055 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ab704-2174-4449-aae6-11f3450583a4 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:03.224251 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ab704-2174-4449-aae6-11f3450583a4 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:03.226117 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 470/935] 10.222.0.52 () {54 vars in 965 bytes} [Wed Aug 31 15:04:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:03.233563 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccf14f-6961-46c6-8334-0ba733a69351 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:03.233846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccf14f-6961-46c6-8334-0ba733a69351 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:03.234339 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccf14f-6961-46c6-8334-0ba733a69351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:03.272799 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-a8ccf14f-6961-46c6-8334-0ba733a69351 None None] MFA Rules not processed for user `5c3e43e391e1470e90b21511b98b0d40`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:03.274250 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-a8ccf14f-6961-46c6-8334-0ba733a69351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:03.281311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 466/936] 10.222.0.52 () {58 vars in 1062 bytes} [Wed Aug 31 15:04:03 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:03.291846 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ab704-2174-4449-aae6-11f3450583a4 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:03.307180 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ab704-2174-4449-aae6-11f3450583a4 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:03.313093 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0286977-2a3f-44b6-bf65-305177e77857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:03.314209 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0286977-2a3f-44b6-bf65-305177e77857 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:03.328006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0286977-2a3f-44b6-bf65-305177e77857 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:03.328006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0286977-2a3f-44b6-bf65-305177e77857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:03.333855 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0286977-2a3f-44b6-bf65-305177e77857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:03.336329 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0286977-2a3f-44b6-bf65-305177e77857 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:03.351272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 471/937] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 15:04:06.486869 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86253a12-9de9-483b-884f-2a69c1cee9e9 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:06.487438 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86253a12-9de9-483b-884f-2a69c1cee9e9 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:06.487557 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86253a12-9de9-483b-884f-2a69c1cee9e9 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:06.489031 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 467/938] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:06.495472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74548f53-0ebe-4b11-815d-bcb673ee806a None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:06.496069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74548f53-0ebe-4b11-815d-bcb673ee806a None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:06.496069 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74548f53-0ebe-4b11-815d-bcb673ee806a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:06.572958 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-74548f53-0ebe-4b11-815d-bcb673ee806a None None] MFA Rules not processed for user `a1a6b4b994b043f9af0ae355141faca2`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:06.574216 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-74548f53-0ebe-4b11-815d-bcb673ee806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:06.671772 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 472/939] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:06 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:07.031127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86253a12-9de9-483b-884f-2a69c1cee9e9 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:07.042224 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86253a12-9de9-483b-884f-2a69c1cee9e9 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:07.045850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c601ae-8f10-4506-8573-d8ccfb260cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:07.046490 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c601ae-8f10-4506-8573-d8ccfb260cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:07.046773 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c601ae-8f10-4506-8573-d8ccfb260cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:07.047044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c601ae-8f10-4506-8573-d8ccfb260cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:07.057076 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c601ae-8f10-4506-8573-d8ccfb260cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:07.058576 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c601ae-8f10-4506-8573-d8ccfb260cc7 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:07.068837 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 468/940] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:07 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:04:10.263546 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88ad31-edc9-4730-9abc-138c6ee677cd None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:10.264136 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88ad31-edc9-4730-9abc-138c6ee677cd None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:10.264136 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88ad31-edc9-4730-9abc-138c6ee677cd None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:10.265460 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 473/941] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 15:04:10.273456 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5cb7-a686-448f-9223-d1458bd2f803 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:10.273984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5cb7-a686-448f-9223-d1458bd2f803 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:10.274346 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5cb7-a686-448f-9223-d1458bd2f803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:10.301926 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-108d5cb7-a686-448f-9223-d1458bd2f803 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:10.303189 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-108d5cb7-a686-448f-9223-d1458bd2f803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:10.376313 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 469/942] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:10 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:10.730980 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88ad31-edc9-4730-9abc-138c6ee677cd None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:10.744353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88ad31-edc9-4730-9abc-138c6ee677cd None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:10.747869 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1ed45-98d1-43ce-b893-caf06da3f124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:10.748470 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1ed45-98d1-43ce-b893-caf06da3f124 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:10.748748 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1ed45-98d1-43ce-b893-caf06da3f124 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:10.749023 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1ed45-98d1-43ce-b893-caf06da3f124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:10.760481 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1ed45-98d1-43ce-b893-caf06da3f124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:10.761988 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1ed45-98d1-43ce-b893-caf06da3f124 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:10.773366 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 474/943] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:10 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:04:14.205391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93547b-fc64-4907-9fd2-868b6466d19b None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:14.205958 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93547b-fc64-4907-9fd2-868b6466d19b None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:14.205958 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93547b-fc64-4907-9fd2-868b6466d19b None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:14.207581 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 470/944] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:14.212663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2287-5ef4-4851-b740-1135de61dfdc None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:14.213075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2287-5ef4-4851-b740-1135de61dfdc None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:14.213208 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2287-5ef4-4851-b740-1135de61dfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:14.233318 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-460e2287-5ef4-4851-b740-1135de61dfdc None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:14.234639 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-460e2287-5ef4-4851-b740-1135de61dfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:14.242915 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 475/945] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:14.582348 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93547b-fc64-4907-9fd2-868b6466d19b None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:14.593044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93547b-fc64-4907-9fd2-868b6466d19b None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:14.597538 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d643c-594d-487b-8cb2-72462f650223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:14.598120 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d643c-594d-487b-8cb2-72462f650223 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:14.598422 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d643c-594d-487b-8cb2-72462f650223 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:14.598694 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d643c-594d-487b-8cb2-72462f650223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:14.607781 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d643c-594d-487b-8cb2-72462f650223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:14.609202 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d643c-594d-487b-8cb2-72462f650223 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:14.618920 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 471/946] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:04:16.880614 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842947d2-af41-4436-a34f-426a5848b9a4 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:16.881119 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842947d2-af41-4436-a34f-426a5848b9a4 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:16.881240 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842947d2-af41-4436-a34f-426a5848b9a4 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:16.882713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 476/947] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:16.887662 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebf647-a24a-4cda-8d35-e57efd452d1e None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:16.888060 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebf647-a24a-4cda-8d35-e57efd452d1e None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:16.888208 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebf647-a24a-4cda-8d35-e57efd452d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:16.908611 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-1eebf647-a24a-4cda-8d35-e57efd452d1e None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:16.909881 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-1eebf647-a24a-4cda-8d35-e57efd452d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:16.917720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 472/948] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:17.259440 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842947d2-af41-4436-a34f-426a5848b9a4 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:17.269963 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842947d2-af41-4436-a34f-426a5848b9a4 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:17.273388 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520a5ac-b9e9-4eea-867a-90f8b98decf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:17.273981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520a5ac-b9e9-4eea-867a-90f8b98decf0 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:17.274261 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520a5ac-b9e9-4eea-867a-90f8b98decf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:17.274559 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520a5ac-b9e9-4eea-867a-90f8b98decf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:17.284031 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520a5ac-b9e9-4eea-867a-90f8b98decf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:17.285446 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520a5ac-b9e9-4eea-867a-90f8b98decf0 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:17.295171 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 477/949] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:04:19.615282 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac21cf-e583-48da-960b-e75d93311527 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:19.615904 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac21cf-e583-48da-960b-e75d93311527 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:19.615904 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac21cf-e583-48da-960b-e75d93311527 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:19.618029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 473/950] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:19.623689 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ca3d4-b945-4ea3-9534-73d2f937c10b None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:19.624239 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ca3d4-b945-4ea3-9534-73d2f937c10b None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:19.624239 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ca3d4-b945-4ea3-9534-73d2f937c10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:19.644901 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-080ca3d4-b945-4ea3-9534-73d2f937c10b None None] MFA Rules not processed for user `a1a6b4b994b043f9af0ae355141faca2`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:19.646170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-080ca3d4-b945-4ea3-9534-73d2f937c10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:19.654189 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 478/951] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:19 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:20.000497 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac21cf-e583-48da-960b-e75d93311527 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:20.013002 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac21cf-e583-48da-960b-e75d93311527 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:20.016569 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e728c-9fe2-4168-b710-5790544fedca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:20.018567 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e728c-9fe2-4168-b710-5790544fedca service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:20.018853 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e728c-9fe2-4168-b710-5790544fedca service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:20.019126 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e728c-9fe2-4168-b710-5790544fedca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:20.029145 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e728c-9fe2-4168-b710-5790544fedca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:20.030661 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e728c-9fe2-4168-b710-5790544fedca service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:20.042509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 474/952] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:19 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:04:23.059418 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf734c-dbde-47c3-bfee-438a3c654927 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:23.059992 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf734c-dbde-47c3-bfee-438a3c654927 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:23.059992 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf734c-dbde-47c3-bfee-438a3c654927 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:23.061223 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 479/953] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:23.067801 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0726b6-dc48-445c-9b61-25480642f115 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:23.071704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0726b6-dc48-445c-9b61-25480642f115 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:23.071704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0726b6-dc48-445c-9b61-25480642f115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:23.088920 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-ea0726b6-dc48-445c-9b61-25480642f115 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:23.094631 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-ea0726b6-dc48-445c-9b61-25480642f115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:23.099603 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 475/954] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:23.442563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf734c-dbde-47c3-bfee-438a3c654927 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:23.453395 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf734c-dbde-47c3-bfee-438a3c654927 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:23.458312 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53ba3a-cb5d-447a-8bfb-bc2906010d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:23.458975 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ba3a-cb5d-447a-8bfb-bc2906010d93 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:23.459257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ba3a-cb5d-447a-8bfb-bc2906010d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:23.459531 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ba3a-cb5d-447a-8bfb-bc2906010d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:23.469052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53ba3a-cb5d-447a-8bfb-bc2906010d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:23.471866 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53ba3a-cb5d-447a-8bfb-bc2906010d93 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:23.481408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 480/955] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:04:25.765499 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ba70b-f3b4-4b1d-ad54-415640e2ec93 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:25.766067 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ba70b-f3b4-4b1d-ad54-415640e2ec93 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:25.766067 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ba70b-f3b4-4b1d-ad54-415640e2ec93 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:25.767794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 476/956] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:25.773302 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d0aa4-7f34-421c-a9e6-9979562e7d49 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:25.773804 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d0aa4-7f34-421c-a9e6-9979562e7d49 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:25.773884 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d0aa4-7f34-421c-a9e6-9979562e7d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:25.792839 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-5d9d0aa4-7f34-421c-a9e6-9979562e7d49 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:25.794052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-5d9d0aa4-7f34-421c-a9e6-9979562e7d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:25.802377 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 481/957] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:26.147616 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ba70b-f3b4-4b1d-ad54-415640e2ec93 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:26.158859 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ba70b-f3b4-4b1d-ad54-415640e2ec93 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:26.162325 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435dbae-44b1-4d5c-9a2d-84a52ca9bc46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:26.162907 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435dbae-44b1-4d5c-9a2d-84a52ca9bc46 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:26.163181 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435dbae-44b1-4d5c-9a2d-84a52ca9bc46 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:26.163452 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435dbae-44b1-4d5c-9a2d-84a52ca9bc46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:26.172394 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435dbae-44b1-4d5c-9a2d-84a52ca9bc46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:26.174476 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435dbae-44b1-4d5c-9a2d-84a52ca9bc46 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:26.183859 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 477/958] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:04:29.020710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01911a2a-5865-4e6c-8584-4a60ce9306b1 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:29.021236 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01911a2a-5865-4e6c-8584-4a60ce9306b1 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:29.021236 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01911a2a-5865-4e6c-8584-4a60ce9306b1 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:29.022644 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 482/959] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:29.028002 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6140e-887d-4e9a-b6bd-ab42ef87c0d2 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:29.028419 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6140e-887d-4e9a-b6bd-ab42ef87c0d2 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:29.028559 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6140e-887d-4e9a-b6bd-ab42ef87c0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:29.048421 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-7ab6140e-887d-4e9a-b6bd-ab42ef87c0d2 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:29.049559 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-7ab6140e-887d-4e9a-b6bd-ab42ef87c0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:29.057426 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 478/960] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:29 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:29.425332 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01911a2a-5865-4e6c-8584-4a60ce9306b1 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:29.430821 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:04:29.436452 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01911a2a-5865-4e6c-8584-4a60ce9306b1 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:29.440702 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20174a-2d61-4cfe-adb7-928e629aa1f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:29.441290 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20174a-2d61-4cfe-adb7-928e629aa1f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:29.441566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20174a-2d61-4cfe-adb7-928e629aa1f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:29.441841 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20174a-2d61-4cfe-adb7-928e629aa1f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:29.451318 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20174a-2d61-4cfe-adb7-928e629aa1f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:29.452740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20174a-2d61-4cfe-adb7-928e629aa1f4 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:29.462790 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 483/961] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:29 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:04:34.076780 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896724c9-ef6e-49ab-90a9-9fcc03c36250 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:34.077340 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896724c9-ef6e-49ab-90a9-9fcc03c36250 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:34.077340 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896724c9-ef6e-49ab-90a9-9fcc03c36250 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:34.079251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 479/962] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:34.084899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e8f2-4304-481d-8b83-3d287e686049 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:34.085376 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e8f2-4304-481d-8b83-3d287e686049 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:34.085567 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e8f2-4304-481d-8b83-3d287e686049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:34.110577 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-1f71e8f2-4304-481d-8b83-3d287e686049 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:34.111907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-1f71e8f2-4304-481d-8b83-3d287e686049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:34.119757 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 484/963] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:34.468179 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896724c9-ef6e-49ab-90a9-9fcc03c36250 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:34.474577 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=82 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:04:34.480619 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896724c9-ef6e-49ab-90a9-9fcc03c36250 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:34.484296 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664a6e-2934-4dbb-b767-d9dc492b75fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:34.484896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664a6e-2934-4dbb-b767-d9dc492b75fc service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:34.489447 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664a6e-2934-4dbb-b767-d9dc492b75fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:34.489447 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664a6e-2934-4dbb-b767-d9dc492b75fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:34.496606 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664a6e-2934-4dbb-b767-d9dc492b75fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:34.498069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664a6e-2934-4dbb-b767-d9dc492b75fc service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:34.509379 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 480/964] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:04:38.097568 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82f6f5-8802-4d12-8565-29b7dc0307fb None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:38.098102 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82f6f5-8802-4d12-8565-29b7dc0307fb None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:38.098102 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82f6f5-8802-4d12-8565-29b7dc0307fb None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:38.099852 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 485/965] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:38.104933 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27befd-d14c-4511-8f78-4546a3ac88dd None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:38.105356 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27befd-d14c-4511-8f78-4546a3ac88dd None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:38.105460 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27befd-d14c-4511-8f78-4546a3ac88dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:38.124620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-0d27befd-d14c-4511-8f78-4546a3ac88dd None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:38.126377 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-0d27befd-d14c-4511-8f78-4546a3ac88dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:38.134457 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 481/966] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:38 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:38.492000 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82f6f5-8802-4d12-8565-29b7dc0307fb None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:38.502826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82f6f5-8802-4d12-8565-29b7dc0307fb None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:38.506439 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd95080-60d2-4366-8fbf-8ab70f94621c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:38.507033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95080-60d2-4366-8fbf-8ab70f94621c service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:38.507307 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95080-60d2-4366-8fbf-8ab70f94621c service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:38.507633 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95080-60d2-4366-8fbf-8ab70f94621c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:38.517677 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd95080-60d2-4366-8fbf-8ab70f94621c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:38.519106 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd95080-60d2-4366-8fbf-8ab70f94621c service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:38.528689 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 486/967] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:38 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:04:43.089807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf0e08-717a-4df4-99d1-6e49f45944c6 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:43.090437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf0e08-717a-4df4-99d1-6e49f45944c6 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:43.090437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf0e08-717a-4df4-99d1-6e49f45944c6 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:43.091838 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 482/968] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 15:04:43.098612 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd75cf-7a8e-4eb5-a18d-c1940e2bc7a8 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:43.099349 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd75cf-7a8e-4eb5-a18d-c1940e2bc7a8 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:43.099349 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd75cf-7a8e-4eb5-a18d-c1940e2bc7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:43.118984 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-f4fd75cf-7a8e-4eb5-a18d-c1940e2bc7a8 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:43.120205 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-f4fd75cf-7a8e-4eb5-a18d-c1940e2bc7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:43.129020 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 487/969] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:43.483801 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf0e08-717a-4df4-99d1-6e49f45944c6 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:04:43.495000 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf0e08-717a-4df4-99d1-6e49f45944c6 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:04:43.498708 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfa55a-81c5-49c0-a807-1b58cd67538a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:04:43.499308 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfa55a-81c5-49c0-a807-1b58cd67538a service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:43.499610 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfa55a-81c5-49c0-a807-1b58cd67538a service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:43.499862 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfa55a-81c5-49c0-a807-1b58cd67538a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:43.510043 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfa55a-81c5-49c0-a807-1b58cd67538a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:04:43.511520 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfa55a-81c5-49c0-a807-1b58cd67538a service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:04:43.521984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 483/970] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:04:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:04:49.330339 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d877b-b76a-40cc-8169-8e8fdf6241ca None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:49.331191 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d877b-b76a-40cc-8169-8e8fdf6241ca None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:49.331473 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d877b-b76a-40cc-8169-8e8fdf6241ca None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:49.333202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 488/971] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 31 15:04:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:49.339876 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abc5e8-f281-48a4-839d-f7c544d82510 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:49.340704 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abc5e8-f281-48a4-839d-f7c544d82510 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:49.346381 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abc5e8-f281-48a4-839d-f7c544d82510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:49.395354 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-91abc5e8-f281-48a4-839d-f7c544d82510 None None] MFA Rules not processed for user `63cdd2ef65aa46fab70d0d09b7d7d17c`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:49.396769 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-91abc5e8-f281-48a4-839d-f7c544d82510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:49.475468 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 484/972] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 31 15:04:49 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:53.113574 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=17 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:04:54.210842 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8821520-470b-4696-876b-76c88b448ca1 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:54.211474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8821520-470b-4696-876b-76c88b448ca1 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:54.211474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8821520-470b-4696-876b-76c88b448ca1 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:54.213331 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 489/973] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 31 15:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:54.218424 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acad8d1-8942-4eb3-af81-d70810aaf42a None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:54.219391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acad8d1-8942-4eb3-af81-d70810aaf42a None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:54.226473 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acad8d1-8942-4eb3-af81-d70810aaf42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:54.244118 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-0acad8d1-8942-4eb3-af81-d70810aaf42a None None] MFA Rules not processed for user `63cdd2ef65aa46fab70d0d09b7d7d17c`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:54.245484 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-0acad8d1-8942-4eb3-af81-d70810aaf42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:54.258464 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 485/974] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 31 15:04:54 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:04:55.940947 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18a3af-c3c2-43c6-9f7e-6b73a54720e0 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:55.941472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18a3af-c3c2-43c6-9f7e-6b73a54720e0 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:55.941472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18a3af-c3c2-43c6-9f7e-6b73a54720e0 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:55.942906 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 490/975] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 31 15:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:55.947985 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f8fe2-1a42-4791-b9b5-4978b51719ab None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:55.948445 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f8fe2-1a42-4791-b9b5-4978b51719ab None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:55.948697 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f8fe2-1a42-4791-b9b5-4978b51719ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:55.970617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-059f8fe2-1a42-4791-b9b5-4978b51719ab None None] MFA Rules not processed for user `63cdd2ef65aa46fab70d0d09b7d7d17c`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:55.971902 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-059f8fe2-1a42-4791-b9b5-4978b51719ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:55.982281 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 486/976] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 31 15:04:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:04:59.945397 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc115c05-0cf4-4f03-8139-049f1d21f1bc None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:59.946833 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc115c05-0cf4-4f03-8139-049f1d21f1bc None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:59.947477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc115c05-0cf4-4f03-8139-049f1d21f1bc None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:59.950249 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 491/977] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:04:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:04:59.956071 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727183c4-8d45-47b0-971e-efaff152be90 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:04:59.958026 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727183c4-8d45-47b0-971e-efaff152be90 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:04:59.958026 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727183c4-8d45-47b0-971e-efaff152be90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:04:59.983265 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-727183c4-8d45-47b0-971e-efaff152be90 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:04:59.985353 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-727183c4-8d45-47b0-971e-efaff152be90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:04:59.996621 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 487/978] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:04:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:00.376444 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dfbaf-fc81-49f5-bf20-3638b8aab012 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:00.376729 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dfbaf-fc81-49f5-bf20-3638b8aab012 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:00.377192 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dfbaf-fc81-49f5-bf20-3638b8aab012 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:00.378818 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 492/979] 10.222.0.52 () {54 vars in 962 bytes} [Wed Aug 31 15:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:00.386951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412f629-795f-4f3f-81d7-39b035339be2 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:00.387417 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412f629-795f-4f3f-81d7-39b035339be2 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:00.387841 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412f629-795f-4f3f-81d7-39b035339be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:00.444438 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-d412f629-795f-4f3f-81d7-39b035339be2 None None] MFA Rules not processed for user `98bb7c83115a45f1bdf9f48c6599db18`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:00.445735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-d412f629-795f-4f3f-81d7-39b035339be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:00.504153 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:05:00.530612 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 488/980] 10.222.0.52 () {58 vars in 1059 bytes} [Wed Aug 31 15:05:00 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:05:00.539087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dfbaf-fc81-49f5-bf20-3638b8aab012 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:00.553143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dfbaf-fc81-49f5-bf20-3638b8aab012 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:00.558256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88e473-6672-429c-96e9-bc4995d0f63d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:00.558883 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e473-6672-429c-96e9-bc4995d0f63d service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:00.559158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e473-6672-429c-96e9-bc4995d0f63d service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:00.559426 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e473-6672-429c-96e9-bc4995d0f63d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:00.568974 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88e473-6672-429c-96e9-bc4995d0f63d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:00.570614 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88e473-6672-429c-96e9-bc4995d0f63d service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:00.581628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 493/981] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:03.071922 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c02254-6431-416d-8255-9682a78dca0a None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:03.072448 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c02254-6431-416d-8255-9682a78dca0a None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:03.072448 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c02254-6431-416d-8255-9682a78dca0a None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:03.073850 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 489/982] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:03.079679 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf10dc1-a414-4ee9-beda-beb11931a88e None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:03.080134 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf10dc1-a414-4ee9-beda-beb11931a88e None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:03.080226 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf10dc1-a414-4ee9-beda-beb11931a88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:03.100177 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-8bf10dc1-a414-4ee9-beda-beb11931a88e None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:03.101371 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-8bf10dc1-a414-4ee9-beda-beb11931a88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:03.109566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 494/983] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:05:03.471877 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c02254-6431-416d-8255-9682a78dca0a None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:03.486501 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c02254-6431-416d-8255-9682a78dca0a None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:03.491670 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65beb775-b0e7-4cb0-ba2f-4dc40ddc95b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:03.492423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65beb775-b0e7-4cb0-ba2f-4dc40ddc95b2 service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:03.492811 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65beb775-b0e7-4cb0-ba2f-4dc40ddc95b2 service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:03.493255 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65beb775-b0e7-4cb0-ba2f-4dc40ddc95b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:03.503421 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65beb775-b0e7-4cb0-ba2f-4dc40ddc95b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:03.505184 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65beb775-b0e7-4cb0-ba2f-4dc40ddc95b2 service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:03.522150 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 490/984] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:06.355694 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d8bb-0970-4901-b5ff-32c43766dd9b None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:06.356215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d8bb-0970-4901-b5ff-32c43766dd9b None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:06.356215 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d8bb-0970-4901-b5ff-32c43766dd9b None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:06.357612 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 495/985] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:06.364135 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39319-120a-4f0e-be63-92036c901049 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:06.364689 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39319-120a-4f0e-be63-92036c901049 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:06.364689 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39319-120a-4f0e-be63-92036c901049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:06.385523 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-02e39319-120a-4f0e-be63-92036c901049 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:06.386767 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-02e39319-120a-4f0e-be63-92036c901049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:06.400932 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 491/986] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:06.753849 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143cc5c-396a-465f-a52d-dbd82ff03913 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:06.754490 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143cc5c-396a-465f-a52d-dbd82ff03913 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:06.754771 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143cc5c-396a-465f-a52d-dbd82ff03913 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:06.756139 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 496/987] 10.222.0.52 () {54 vars in 962 bytes} [Wed Aug 31 15:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:06.761902 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2812-90a2-4156-af45-d35817c5bff9 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:06.773286 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2812-90a2-4156-af45-d35817c5bff9 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:06.773286 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2812-90a2-4156-af45-d35817c5bff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:06.787612 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-b82c2812-90a2-4156-af45-d35817c5bff9 None None] MFA Rules not processed for user `98bb7c83115a45f1bdf9f48c6599db18`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:06.788831 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-b82c2812-90a2-4156-af45-d35817c5bff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:06.800458 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 492/988] 10.222.0.52 () {58 vars in 1059 bytes} [Wed Aug 31 15:05:06 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:06.808663 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143cc5c-396a-465f-a52d-dbd82ff03913 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:06.823620 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143cc5c-396a-465f-a52d-dbd82ff03913 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:06.834787 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951308a-bddc-4f3d-8523-47e0e20d779e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:06.835643 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951308a-bddc-4f3d-8523-47e0e20d779e service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:06.836058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951308a-bddc-4f3d-8523-47e0e20d779e service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:06.836489 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951308a-bddc-4f3d-8523-47e0e20d779e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:06.851606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951308a-bddc-4f3d-8523-47e0e20d779e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:06.854191 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951308a-bddc-4f3d-8523-47e0e20d779e service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:06.866625 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 497/989] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:09.464779 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd5e3-ef5f-4f88-9e27-d1318af5e403 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:09.466441 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd5e3-ef5f-4f88-9e27-d1318af5e403 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:09.466944 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd5e3-ef5f-4f88-9e27-d1318af5e403 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:09.476166 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3756d7-21b2-4e61-a9ea-11e5c02b967b None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:09.477242 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3756d7-21b2-4e61-a9ea-11e5c02b967b None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:09.477766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3756d7-21b2-4e61-a9ea-11e5c02b967b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:09.480735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 493/990] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:09.500770 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-2f3756d7-21b2-4e61-a9ea-11e5c02b967b None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:09.502407 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-2f3756d7-21b2-4e61-a9ea-11e5c02b967b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:09.511070 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 498/991] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:09.892889 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dd5e3-ef5f-4f88-9e27-d1318af5e403 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:09.909983 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dd5e3-ef5f-4f88-9e27-d1318af5e403 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:09.915898 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f183a10-77ae-4788-a0bb-602f069a33b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:09.916972 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f183a10-77ae-4788-a0bb-602f069a33b6 service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:09.917511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f183a10-77ae-4788-a0bb-602f069a33b6 service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:09.917999 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f183a10-77ae-4788-a0bb-602f069a33b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:09.929238 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f183a10-77ae-4788-a0bb-602f069a33b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:09.932750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f183a10-77ae-4788-a0bb-602f069a33b6 service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:09.945433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 494/992] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:10.617713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98665-ccd1-401b-a41d-4effd4864447 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:10.618785 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98665-ccd1-401b-a41d-4effd4864447 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:10.619305 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98665-ccd1-401b-a41d-4effd4864447 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:10.626509 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5dd92-67b3-4fda-8239-4db1e223d756 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:10.627391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5dd92-67b3-4fda-8239-4db1e223d756 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:10.627881 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5dd92-67b3-4fda-8239-4db1e223d756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:10.631033 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 499/993] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 15:05:10.648786 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-45c5dd92-67b3-4fda-8239-4db1e223d756 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:10.650335 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-45c5dd92-67b3-4fda-8239-4db1e223d756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:10.667943 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 495/994] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:11.307166 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbccc1-2e81-4501-be78-959663e7f3ff None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:11.307760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbccc1-2e81-4501-be78-959663e7f3ff None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:11.308320 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbccc1-2e81-4501-be78-959663e7f3ff None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:11.310952 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 500/995] 10.222.0.52 () {54 vars in 964 bytes} [Wed Aug 31 15:05:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:11.320311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fbd42-623c-484c-82eb-5e734852c02e None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:11.321051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fbd42-623c-484c-82eb-5e734852c02e None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:11.321678 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fbd42-623c-484c-82eb-5e734852c02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:11.408423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-ed2fbd42-623c-484c-82eb-5e734852c02e None None] MFA Rules not processed for user `1308dea6ef324bf388a0339ca911f36c`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:11.410073 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-ed2fbd42-623c-484c-82eb-5e734852c02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:11.502398 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 496/996] 10.222.0.52 () {58 vars in 1061 bytes} [Wed Aug 31 15:05:11 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:11.507369 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbccc1-2e81-4501-be78-959663e7f3ff None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:11.520564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbccc1-2e81-4501-be78-959663e7f3ff None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:11.526832 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fda3c7-8a9e-49b4-a19a-61c387436347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1308dea6ef324bf388a0339ca911f36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:11.527847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fda3c7-8a9e-49b4-a19a-61c387436347 service cinder] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:11.528308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fda3c7-8a9e-49b4-a19a-61c387436347 service cinder] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:11.528832 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fda3c7-8a9e-49b4-a19a-61c387436347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:11.541397 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fda3c7-8a9e-49b4-a19a-61c387436347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:11.543585 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fda3c7-8a9e-49b4-a19a-61c387436347 service cinder] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:11.555847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 501/997] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:12.641076 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2fff6-e143-408b-97f1-a95db6f0ebef None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:12.642170 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2fff6-e143-408b-97f1-a95db6f0ebef None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:12.642777 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2fff6-e143-408b-97f1-a95db6f0ebef None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:12.649130 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 497/998] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:12.650598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffc0b7-e6c4-407b-8354-7df49ded7400 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:12.651180 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffc0b7-e6c4-407b-8354-7df49ded7400 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:12.651180 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffc0b7-e6c4-407b-8354-7df49ded7400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:12.677257 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-e9ffc0b7-e6c4-407b-8354-7df49ded7400 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:12.680664 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-e9ffc0b7-e6c4-407b-8354-7df49ded7400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:12.690225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 502/999] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:13.053584 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2fff6-e143-408b-97f1-a95db6f0ebef None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:13.064412 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2fff6-e143-408b-97f1-a95db6f0ebef None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:13.069703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cd212-3edb-45ac-89b8-0b0beaed19fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:13.070442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cd212-3edb-45ac-89b8-0b0beaed19fe service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:13.070755 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cd212-3edb-45ac-89b8-0b0beaed19fe service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:13.071029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cd212-3edb-45ac-89b8-0b0beaed19fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:13.081316 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cd212-3edb-45ac-89b8-0b0beaed19fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:13.083027 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cd212-3edb-45ac-89b8-0b0beaed19fe service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:13.094920 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 498/1000] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:15.499860 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4350d-3f75-4155-b8da-6d851a134325 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:15.500371 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4350d-3f75-4155-b8da-6d851a134325 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:15.500465 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4350d-3f75-4155-b8da-6d851a134325 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:15.501764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 503/1001] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:15.507174 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c437-e95b-467f-b2ae-d3bf917ac381 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:15.507662 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c437-e95b-467f-b2ae-d3bf917ac381 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:15.507845 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29c437-e95b-467f-b2ae-d3bf917ac381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:15.533045 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-db29c437-e95b-467f-b2ae-d3bf917ac381 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:15.534319 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-db29c437-e95b-467f-b2ae-d3bf917ac381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:15.542945 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 499/1002] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:05:15.901692 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4350d-3f75-4155-b8da-6d851a134325 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:15.916046 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4350d-3f75-4155-b8da-6d851a134325 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:15.921649 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae134b-3d64-4e98-9e30-133c94ba3b68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:15.922492 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae134b-3d64-4e98-9e30-133c94ba3b68 service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:15.922775 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae134b-3d64-4e98-9e30-133c94ba3b68 service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:15.923057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae134b-3d64-4e98-9e30-133c94ba3b68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:15.931879 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae134b-3d64-4e98-9e30-133c94ba3b68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:15.938230 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae134b-3d64-4e98-9e30-133c94ba3b68 service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:15.944680 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 504/1003] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:18.489391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a8b26-e42d-4ff9-ac38-37d87f6dfa4a None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:18.490767 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a8b26-e42d-4ff9-ac38-37d87f6dfa4a None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:18.491381 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a8b26-e42d-4ff9-ac38-37d87f6dfa4a None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:18.493700 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 500/1004] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:18.500048 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5e365-aee3-4251-b370-373c20b1f478 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:18.501697 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5e365-aee3-4251-b370-373c20b1f478 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:18.502700 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5e365-aee3-4251-b370-373c20b1f478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:18.527159 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-52c5e365-aee3-4251-b370-373c20b1f478 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:18.528440 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-52c5e365-aee3-4251-b370-373c20b1f478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:18.537834 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 505/1005] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:18.899973 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a8b26-e42d-4ff9-ac38-37d87f6dfa4a None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:18.915912 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a8b26-e42d-4ff9-ac38-37d87f6dfa4a None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:18.925758 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fb4e9-d6ce-4c34-adb5-705d117fdff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:18.926503 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fb4e9-d6ce-4c34-adb5-705d117fdff5 service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:18.926781 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fb4e9-d6ce-4c34-adb5-705d117fdff5 service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:18.927039 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fb4e9-d6ce-4c34-adb5-705d117fdff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:18.937546 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fb4e9-d6ce-4c34-adb5-705d117fdff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:18.939719 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fb4e9-d6ce-4c34-adb5-705d117fdff5 service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:18.951108 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 501/1006] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:21.476367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3175c-20f6-4fab-bbea-5aa989f71cfc None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:21.477344 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3175c-20f6-4fab-bbea-5aa989f71cfc None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:21.477646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3175c-20f6-4fab-bbea-5aa989f71cfc None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:21.479275 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 506/1007] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:21.485886 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2d9d8-ad4a-41ea-b2c4-501bfc9aad0f None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:21.486434 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2d9d8-ad4a-41ea-b2c4-501bfc9aad0f None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:21.486629 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2d9d8-ad4a-41ea-b2c4-501bfc9aad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:21.511637 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-47b2d9d8-ad4a-41ea-b2c4-501bfc9aad0f None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:21.512916 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-47b2d9d8-ad4a-41ea-b2c4-501bfc9aad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:21.521648 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 502/1008] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:21.981676 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3175c-20f6-4fab-bbea-5aa989f71cfc None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:21.995544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3175c-20f6-4fab-bbea-5aa989f71cfc None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:22.001181 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36230739-4101-474c-a363-8f7fcb584b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:22.001807 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36230739-4101-474c-a363-8f7fcb584b8c service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:22.002081 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36230739-4101-474c-a363-8f7fcb584b8c service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:22.002384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36230739-4101-474c-a363-8f7fcb584b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:22.010913 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36230739-4101-474c-a363-8f7fcb584b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:22.012498 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36230739-4101-474c-a363-8f7fcb584b8c service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:22.023224 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 507/1009] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:25.502559 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d9fe-43fe-4ea8-ac6c-a32537afe62a None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:25.503232 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d9fe-43fe-4ea8-ac6c-a32537afe62a None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:25.503232 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d9fe-43fe-4ea8-ac6c-a32537afe62a None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:25.505494 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 503/1010] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:25.516180 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dbf35-d7c9-48ca-b876-313909ac96a9 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:25.516793 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dbf35-d7c9-48ca-b876-313909ac96a9 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:25.516793 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dbf35-d7c9-48ca-b876-313909ac96a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:25.524962 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=43 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:05:25.539176 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-286dbf35-d7c9-48ca-b876-313909ac96a9 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:25.540401 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-286dbf35-d7c9-48ca-b876-313909ac96a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:25.549528 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 508/1011] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:25.911044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d9fe-43fe-4ea8-ac6c-a32537afe62a None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:25.925448 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d9fe-43fe-4ea8-ac6c-a32537afe62a None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:25.931614 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1dcb0-a470-4b7e-853e-1dd918c10f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:25.932658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1dcb0-a470-4b7e-853e-1dd918c10f18 service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:25.932658 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1dcb0-a470-4b7e-853e-1dd918c10f18 service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:25.932965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1dcb0-a470-4b7e-853e-1dd918c10f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:25.943276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1dcb0-a470-4b7e-853e-1dd918c10f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:25.944822 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1dcb0-a470-4b7e-853e-1dd918c10f18 service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:25.961247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 504/1012] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 15:05:28.510381 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c74c0-9792-4b2e-9eaa-e92502f460e6 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:28.511081 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c74c0-9792-4b2e-9eaa-e92502f460e6 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:28.511081 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c74c0-9792-4b2e-9eaa-e92502f460e6 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:28.512288 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 509/1013] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:28.518472 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666238d-99a1-4cea-8cb1-92940d3fa0f9 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:28.519029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666238d-99a1-4cea-8cb1-92940d3fa0f9 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:28.519029 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666238d-99a1-4cea-8cb1-92940d3fa0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:28.541376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-b666238d-99a1-4cea-8cb1-92940d3fa0f9 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:28.541376 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-b666238d-99a1-4cea-8cb1-92940d3fa0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:28.550227 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 505/1014] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:28.592685 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20cc3-5ca2-4f10-9cf0-49f2367b4b56 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:28.593060 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20cc3-5ca2-4f10-9cf0-49f2367b4b56 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:28.593440 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20cc3-5ca2-4f10-9cf0-49f2367b4b56 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:28.595252 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 510/1015] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:28.601172 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5e3ae-3764-41c0-8075-b84f70c4f6a8 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:28.601452 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5e3ae-3764-41c0-8075-b84f70c4f6a8 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:28.601723 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5e3ae-3764-41c0-8075-b84f70c4f6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:28.621437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-44d5e3ae-3764-41c0-8075-b84f70c4f6a8 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:28.622671 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-44d5e3ae-3764-41c0-8075-b84f70c4f6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:28.631006 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 506/1016] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:28.902436 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c20cc3-5ca2-4f10-9cf0-49f2367b4b56 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:28.916703 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c20cc3-5ca2-4f10-9cf0-49f2367b4b56 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:28.922008 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bc2b4-54e1-4235-a704-aaed987db64f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:28.922654 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bc2b4-54e1-4235-a704-aaed987db64f service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:28.922974 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bc2b4-54e1-4235-a704-aaed987db64f service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:28.923214 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bc2b4-54e1-4235-a704-aaed987db64f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:28.932134 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bc2b4-54e1-4235-a704-aaed987db64f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:28.934839 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bc2b4-54e1-4235-a704-aaed987db64f service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:28.944896 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 511/1017] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:29.077365 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fefa0-9b8f-4b36-8cd4-eddc571ba1e8 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:29.077749 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fefa0-9b8f-4b36-8cd4-eddc571ba1e8 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:29.078026 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fefa0-9b8f-4b36-8cd4-eddc571ba1e8 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:29.079651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 507/1018] 10.222.0.52 () {54 vars in 967 bytes} [Wed Aug 31 15:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:29.085631 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3375ca-ad4b-4107-9236-588d19c7b2f7 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:29.085921 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3375ca-ad4b-4107-9236-588d19c7b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:29.086201 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3375ca-ad4b-4107-9236-588d19c7b2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:29.145066 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-ba3375ca-ad4b-4107-9236-588d19c7b2f7 None None] MFA Rules not processed for user `7e0027b550fa4eaaa3f95da115d7da02`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:29.146521 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-ba3375ca-ad4b-4107-9236-588d19c7b2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:29.218574 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 512/1019] 10.222.0.52 () {58 vars in 1064 bytes} [Wed Aug 31 15:05:29 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:29.226550 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fefa0-9b8f-4b36-8cd4-eddc571ba1e8 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:29.238367 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fefa0-9b8f-4b36-8cd4-eddc571ba1e8 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:29.242000 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dac30-d876-4287-8569-9219ae5c4450 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0027b550fa4eaaa3f95da115d7da02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:29.242656 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dac30-d876-4287-8569-9219ae5c4450 service glance] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:29.242942 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dac30-d876-4287-8569-9219ae5c4450 service glance] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:29.243216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dac30-d876-4287-8569-9219ae5c4450 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:29.258700 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dac30-d876-4287-8569-9219ae5c4450 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:29.260170 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dac30-d876-4287-8569-9219ae5c4450 service glance] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:29.265326 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=100 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:05:29.272459 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 508/1020] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:31.738178 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabffcb0-6eee-4005-a9cc-9de64b94140d None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:31.738178 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabffcb0-6eee-4005-a9cc-9de64b94140d None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:31.738178 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabffcb0-6eee-4005-a9cc-9de64b94140d None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:31.738178 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 513/1021] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:31.743218 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc09832-4d5f-42b7-aee4-6b0a72e30af2 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:31.743898 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc09832-4d5f-42b7-aee4-6b0a72e30af2 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:31.743898 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc09832-4d5f-42b7-aee4-6b0a72e30af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:31.766917 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-9cc09832-4d5f-42b7-aee4-6b0a72e30af2 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:31.768136 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-9cc09832-4d5f-42b7-aee4-6b0a72e30af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:31.781163 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 509/1022] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:32.134110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabffcb0-6eee-4005-a9cc-9de64b94140d None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:32.150378 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabffcb0-6eee-4005-a9cc-9de64b94140d None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:32.156940 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b6f4-99a8-4a40-a031-605017a771d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:32.157629 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b6f4-99a8-4a40-a031-605017a771d4 service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:32.157978 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b6f4-99a8-4a40-a031-605017a771d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:32.158343 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b6f4-99a8-4a40-a031-605017a771d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:32.167849 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13b6f4-99a8-4a40-a031-605017a771d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:32.169443 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13b6f4-99a8-4a40-a031-605017a771d4 service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:32.186783 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 514/1023] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:35.026590 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9711612-5d95-478d-9e0e-a8df08e00c0e None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:35.074521 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9711612-5d95-478d-9e0e-a8df08e00c0e None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:35.074521 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9711612-5d95-478d-9e0e-a8df08e00c0e None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:35.074521 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 510/1024] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:35.074858 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c62f1-9634-4913-9527-a8491cd9b789 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:35.074858 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c62f1-9634-4913-9527-a8491cd9b789 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:35.074858 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c62f1-9634-4913-9527-a8491cd9b789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:35.074858 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-b42c62f1-9634-4913-9527-a8491cd9b789 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:35.074858 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-b42c62f1-9634-4913-9527-a8491cd9b789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:35.080712 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 515/1025] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:05:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:35.444160 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9711612-5d95-478d-9e0e-a8df08e00c0e None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:35.460149 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9711612-5d95-478d-9e0e-a8df08e00c0e None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:35.465944 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abf257-39c1-4699-becf-d0f4f789f187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:35.467443 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf257-39c1-4699-becf-d0f4f789f187 service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:35.467588 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf257-39c1-4699-becf-d0f4f789f187 service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:35.467854 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf257-39c1-4699-becf-d0f4f789f187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:35.477459 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abf257-39c1-4699-becf-d0f4f789f187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:35.479117 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abf257-39c1-4699-becf-d0f4f789f187 service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:35.489953 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 511/1026] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:45.054284 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=55 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:05:45.485070 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=10 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:05:45.855828 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9192446-3f9b-4993-98da-e27e71b9c1c2 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:45.856116 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9192446-3f9b-4993-98da-e27e71b9c1c2 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:45.856389 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9192446-3f9b-4993-98da-e27e71b9c1c2 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:45.857819 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 516/1027] 10.222.0.52 () {54 vars in 918 bytes} [Wed Aug 31 15:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:45.863287 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c186d39-2269-4bcf-bfde-61808905b0eb None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:45.863572 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c186d39-2269-4bcf-bfde-61808905b0eb None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:45.863846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c186d39-2269-4bcf-bfde-61808905b0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:45.883259 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-9c186d39-2269-4bcf-bfde-61808905b0eb None None] MFA Rules not processed for user `63cdd2ef65aa46fab70d0d09b7d7d17c`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:45.884467 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-9c186d39-2269-4bcf-bfde-61808905b0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:45.893913 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 512/1028] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 31 15:05:45 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:45.908809 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af1cfe-a62f-4024-817a-0e75da1d53ce None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:45.909087 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af1cfe-a62f-4024-817a-0e75da1d53ce None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:45.909356 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af1cfe-a62f-4024-817a-0e75da1d53ce None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:45.910732 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 517/1029] 10.222.0.52 () {54 vars in 918 bytes} [Wed Aug 31 15:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:45.917103 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc542bd-b6ea-4c1d-8a78-17ebf8754fa3 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:45.917103 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc542bd-b6ea-4c1d-8a78-17ebf8754fa3 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:45.917103 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc542bd-b6ea-4c1d-8a78-17ebf8754fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:45.935824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-ebc542bd-b6ea-4c1d-8a78-17ebf8754fa3 None None] MFA Rules not processed for user `98bb7c83115a45f1bdf9f48c6599db18`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:45.937038 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-ebc542bd-b6ea-4c1d-8a78-17ebf8754fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:45.945618 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 513/1030] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 31 15:05:45 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:48.650886 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082ee42-6b58-48ff-bed1-132c0d719441 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:48.651516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082ee42-6b58-48ff-bed1-132c0d719441 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:48.651516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082ee42-6b58-48ff-bed1-132c0d719441 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:48.652755 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 518/1031] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:48.658058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85102c9-d2f9-424d-88a9-dc4d954d73f4 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:48.658567 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85102c9-d2f9-424d-88a9-dc4d954d73f4 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:48.658725 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85102c9-d2f9-424d-88a9-dc4d954d73f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:48.677738 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-d85102c9-d2f9-424d-88a9-dc4d954d73f4 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:48.678959 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-d85102c9-d2f9-424d-88a9-dc4d954d73f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:48.687169 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 514/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:05:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:49.037766 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082ee42-6b58-48ff-bed1-132c0d719441 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:49.052258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082ee42-6b58-48ff-bed1-132c0d719441 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:49.057228 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ceade5-a4b6-4941-9123-5801060bc9f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:49.057828 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceade5-a4b6-4941-9123-5801060bc9f5 service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:49.058107 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceade5-a4b6-4941-9123-5801060bc9f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:49.058416 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceade5-a4b6-4941-9123-5801060bc9f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:49.067611 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ceade5-a4b6-4941-9123-5801060bc9f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:49.069309 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ceade5-a4b6-4941-9123-5801060bc9f5 service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:49.079184 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 519/1033] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:50.047940 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc1a01-c31b-419e-8032-0b5f27a93008 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:50.048525 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc1a01-c31b-419e-8032-0b5f27a93008 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:50.048525 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc1a01-c31b-419e-8032-0b5f27a93008 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:50.049846 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 515/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 15:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:50.054791 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c6664-72c7-4772-9819-ec98821f1fc1 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:50.055242 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c6664-72c7-4772-9819-ec98821f1fc1 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:50.055349 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c6664-72c7-4772-9819-ec98821f1fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:50.076494 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-301c6664-72c7-4772-9819-ec98821f1fc1 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:50.077714 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-301c6664-72c7-4772-9819-ec98821f1fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:50.085561 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 520/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 15:05:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:50.305380 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc1a01-c31b-419e-8032-0b5f27a93008 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:50.320434 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc1a01-c31b-419e-8032-0b5f27a93008 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:50.325815 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35646520-05c8-4eaf-9ac2-939c8a09029d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:50.334316 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35646520-05c8-4eaf-9ac2-939c8a09029d service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:50.334316 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35646520-05c8-4eaf-9ac2-939c8a09029d service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:50.334316 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35646520-05c8-4eaf-9ac2-939c8a09029d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:50.336888 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35646520-05c8-4eaf-9ac2-939c8a09029d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:50.338544 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35646520-05c8-4eaf-9ac2-939c8a09029d service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:50.349095 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 516/1036] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:51.311059 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8688d-2326-4419-9de9-614675d2f5f5 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:51.311648 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8688d-2326-4419-9de9-614675d2f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:51.311648 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8688d-2326-4419-9de9-614675d2f5f5 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:51.312947 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 521/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 15:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:51.318143 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5f5d9-1420-4c63-9109-55e3f4860749 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:51.318600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5f5d9-1420-4c63-9109-55e3f4860749 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:51.318735 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5f5d9-1420-4c63-9109-55e3f4860749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:51.339131 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-cce5f5d9-1420-4c63-9109-55e3f4860749 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:51.340328 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-cce5f5d9-1420-4c63-9109-55e3f4860749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:51.349121 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 517/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 15:05:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:51.507918 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8688d-2326-4419-9de9-614675d2f5f5 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:51.522406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8688d-2326-4419-9de9-614675d2f5f5 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:51.527744 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674df090-5059-4912-8974-1639fdaf6c5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:51.529021 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674df090-5059-4912-8974-1639fdaf6c5b service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:51.529294 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674df090-5059-4912-8974-1639fdaf6c5b service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:51.529567 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674df090-5059-4912-8974-1639fdaf6c5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:51.538523 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674df090-5059-4912-8974-1639fdaf6c5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:51.540103 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674df090-5059-4912-8974-1639fdaf6c5b service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:51.550920 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 522/1039] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:52.484153 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677045db-7dec-425b-9ccb-00679e131f7f None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:52.484697 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677045db-7dec-425b-9ccb-00679e131f7f None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:52.484697 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677045db-7dec-425b-9ccb-00679e131f7f None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:52.486041 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 518/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 15:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:52.491189 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8844-4778-40e2-8ad7-b749fa38763e None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:52.492130 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8844-4778-40e2-8ad7-b749fa38763e None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:52.492130 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8844-4778-40e2-8ad7-b749fa38763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:52.511878 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-f25e8844-4778-40e2-8ad7-b749fa38763e None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:52.514383 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-f25e8844-4778-40e2-8ad7-b749fa38763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:52.522180 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 523/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 15:05:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:52.679127 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677045db-7dec-425b-9ccb-00679e131f7f None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:52.693419 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677045db-7dec-425b-9ccb-00679e131f7f None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:52.698407 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6049e2-19de-4a39-886d-c9144d065b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:52.699007 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6049e2-19de-4a39-886d-c9144d065b56 service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:52.699287 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6049e2-19de-4a39-886d-c9144d065b56 service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:52.699566 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6049e2-19de-4a39-886d-c9144d065b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:52.708556 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6049e2-19de-4a39-886d-c9144d065b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:52.710148 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6049e2-19de-4a39-886d-c9144d065b56 service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:52.720587 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 519/1042] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:53.597620 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574dc4a-326f-4a9d-8c0b-0c3b3f7b76f3 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:53.598185 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574dc4a-326f-4a9d-8c0b-0c3b3f7b76f3 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:53.598185 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574dc4a-326f-4a9d-8c0b-0c3b3f7b76f3 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:53.599521 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 524/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 15:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:53.604367 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eb7f2-acea-4bd1-990e-85a6375b0255 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:53.604788 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eb7f2-acea-4bd1-990e-85a6375b0255 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:53.604892 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eb7f2-acea-4bd1-990e-85a6375b0255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:53.625493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-ca4eb7f2-acea-4bd1-990e-85a6375b0255 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:53.626725 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-ca4eb7f2-acea-4bd1-990e-85a6375b0255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:53.634553 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 520/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 15:05:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:53.791007 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574dc4a-326f-4a9d-8c0b-0c3b3f7b76f3 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:53.805327 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574dc4a-326f-4a9d-8c0b-0c3b3f7b76f3 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:53.810402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea54f0-c74a-4429-9c75-75cc832eacb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:53.810997 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea54f0-c74a-4429-9c75-75cc832eacb3 service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:53.811278 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea54f0-c74a-4429-9c75-75cc832eacb3 service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:53.811551 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea54f0-c74a-4429-9c75-75cc832eacb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:53.819646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea54f0-c74a-4429-9c75-75cc832eacb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:53.821207 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea54f0-c74a-4429-9c75-75cc832eacb3 service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:53.830806 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 525/1045] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:54.716250 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85067946-3234-4ee2-8c7f-f0ca58832d44 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:54.716806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85067946-3234-4ee2-8c7f-f0ca58832d44 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:54.716806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85067946-3234-4ee2-8c7f-f0ca58832d44 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:54.718130 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 521/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 15:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:54.723284 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f9d5-1f57-4d8e-b7ad-f774e5820695 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:54.723740 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f9d5-1f57-4d8e-b7ad-f774e5820695 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:54.723835 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f9d5-1f57-4d8e-b7ad-f774e5820695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:54.742927 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-d205f9d5-1f57-4d8e-b7ad-f774e5820695 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:54.744110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-d205f9d5-1f57-4d8e-b7ad-f774e5820695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:54.752542 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 526/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 15:05:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:54.914498 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85067946-3234-4ee2-8c7f-f0ca58832d44 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:54.927737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85067946-3234-4ee2-8c7f-f0ca58832d44 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:54.932594 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576dd6b-087c-4ca4-8d50-023a9ef9816a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:54.933182 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576dd6b-087c-4ca4-8d50-023a9ef9816a service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:54.933457 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576dd6b-087c-4ca4-8d50-023a9ef9816a service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:54.933729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576dd6b-087c-4ca4-8d50-023a9ef9816a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:54.942066 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576dd6b-087c-4ca4-8d50-023a9ef9816a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:54.943773 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576dd6b-087c-4ca4-8d50-023a9ef9816a service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:54.954357 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 522/1048] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:55.863993 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d1c5e-7462-4d79-9248-ad3442ba6d93 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:55.864456 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d1c5e-7462-4d79-9248-ad3442ba6d93 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:55.864554 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d1c5e-7462-4d79-9248-ad3442ba6d93 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:55.865895 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 527/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 15:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:55.870770 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be683350-ce4f-410d-bf55-386af400a958 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:55.871187 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be683350-ce4f-410d-bf55-386af400a958 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:55.876260 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be683350-ce4f-410d-bf55-386af400a958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:55.892451 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-be683350-ce4f-410d-bf55-386af400a958 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:55.893661 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-be683350-ce4f-410d-bf55-386af400a958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:55.901853 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 523/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 15:05:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:56.058304 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d1c5e-7462-4d79-9248-ad3442ba6d93 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:56.072454 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d1c5e-7462-4d79-9248-ad3442ba6d93 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:56.078160 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412396f-ac4b-4b24-9bcc-1b17b02b8d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:56.078785 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412396f-ac4b-4b24-9bcc-1b17b02b8d8a service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:56.079063 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412396f-ac4b-4b24-9bcc-1b17b02b8d8a service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:56.079433 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412396f-ac4b-4b24-9bcc-1b17b02b8d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:56.087764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412396f-ac4b-4b24-9bcc-1b17b02b8d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:56.089315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412396f-ac4b-4b24-9bcc-1b17b02b8d8a service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:56.099107 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 528/1051] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:56.997965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef7315-575c-4831-84ad-34a17d041317 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:56.998574 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef7315-575c-4831-84ad-34a17d041317 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:56.998574 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef7315-575c-4831-84ad-34a17d041317 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:56.999867 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 524/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 15:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:57.004661 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6470c-05f3-4c96-8431-d1262a820230 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:57.005110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6470c-05f3-4c96-8431-d1262a820230 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:57.005225 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6470c-05f3-4c96-8431-d1262a820230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:57.024321 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-12e6470c-05f3-4c96-8431-d1262a820230 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:57.025500 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-12e6470c-05f3-4c96-8431-d1262a820230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:57.033761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 529/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 15:05:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:57.194872 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef7315-575c-4831-84ad-34a17d041317 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:57.208913 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef7315-575c-4831-84ad-34a17d041317 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:57.215184 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef06d81-6294-4ef5-8d70-c5d08149b671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:57.216946 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef06d81-6294-4ef5-8d70-c5d08149b671 service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:57.217233 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef06d81-6294-4ef5-8d70-c5d08149b671 service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:57.217505 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef06d81-6294-4ef5-8d70-c5d08149b671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:57.226005 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef06d81-6294-4ef5-8d70-c5d08149b671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:57.227628 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef06d81-6294-4ef5-8d70-c5d08149b671 service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:57.237625 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 525/1054] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:05:58.117077 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc373bee-7065-49da-a333-84fd9acda8eb None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:58.117669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc373bee-7065-49da-a333-84fd9acda8eb None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:58.117669 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc373bee-7065-49da-a333-84fd9acda8eb None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:58.118995 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 530/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 15:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:05:58.124482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc807a6-acd4-4821-ab8c-f1d582e1be2e None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:58.124898 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc807a6-acd4-4821-ab8c-f1d582e1be2e None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:58.125030 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc807a6-acd4-4821-ab8c-f1d582e1be2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:58.144015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-7dc807a6-acd4-4821-ab8c-f1d582e1be2e None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:05:58.145189 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-7dc807a6-acd4-4821-ab8c-f1d582e1be2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:05:58.153352 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 526/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 15:05:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:05:58.307813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc373bee-7065-49da-a333-84fd9acda8eb None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:05:58.321527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc373bee-7065-49da-a333-84fd9acda8eb None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:05:58.327175 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbb422-bc77-4e5e-89fb-e2d5ae0c67d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:05:58.327774 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbb422-bc77-4e5e-89fb-e2d5ae0c67d2 service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:05:58.328051 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbb422-bc77-4e5e-89fb-e2d5ae0c67d2 service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:05:58.328320 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbb422-bc77-4e5e-89fb-e2d5ae0c67d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:05:58.336259 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbb422-bc77-4e5e-89fb-e2d5ae0c67d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:05:58.337837 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbb422-bc77-4e5e-89fb-e2d5ae0c67d2 service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:05:58.347507 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 531/1057] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:05:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:06:00.400111 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4106b40-f113-44b3-9230-c2d5c8e38a5b None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:00.400655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4106b40-f113-44b3-9230-c2d5c8e38a5b None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:00.400655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4106b40-f113-44b3-9230-c2d5c8e38a5b None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:00.401978 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 527/1058] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:00.407870 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b025411-2b50-473c-9396-e00170b05570 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:00.408319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b025411-2b50-473c-9396-e00170b05570 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:00.408427 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b025411-2b50-473c-9396-e00170b05570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:00.427659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-1b025411-2b50-473c-9396-e00170b05570 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:00.428864 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-1b025411-2b50-473c-9396-e00170b05570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:00.437600 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 532/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:06:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:00.775330 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4106b40-f113-44b3-9230-c2d5c8e38a5b None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:00.786469 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4106b40-f113-44b3-9230-c2d5c8e38a5b None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:00.789930 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c8f99-bb80-40f9-9bb9-6f0204eb5b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:00.790557 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c8f99-bb80-40f9-9bb9-6f0204eb5b3c service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:00.790835 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c8f99-bb80-40f9-9bb9-6f0204eb5b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:00.791104 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c8f99-bb80-40f9-9bb9-6f0204eb5b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:00.800749 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c8f99-bb80-40f9-9bb9-6f0204eb5b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:00.802197 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c8f99-bb80-40f9-9bb9-6f0204eb5b3c service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:00.811364 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 528/1060] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:06:03.184761 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89b338-acfc-4851-9eb0-5ce0ef7c89b6 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:03.185412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89b338-acfc-4851-9eb0-5ce0ef7c89b6 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:03.185412 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89b338-acfc-4851-9eb0-5ce0ef7c89b6 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:03.187362 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 533/1061] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:03.193394 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196b882-d7c3-4337-88db-e4bbb6c98cbf None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:03.194086 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196b882-d7c3-4337-88db-e4bbb6c98cbf None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:03.194086 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196b882-d7c3-4337-88db-e4bbb6c98cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:03.215803 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-a196b882-d7c3-4337-88db-e4bbb6c98cbf None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:03.217478 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-a196b882-d7c3-4337-88db-e4bbb6c98cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:03.225723 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 529/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:06:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:03.591655 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89b338-acfc-4851-9eb0-5ce0ef7c89b6 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:03.603311 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89b338-acfc-4851-9eb0-5ce0ef7c89b6 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:03.607330 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e36a16-2b48-43c0-a6ea-9487caa023ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:03.607959 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e36a16-2b48-43c0-a6ea-9487caa023ef service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:03.608266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e36a16-2b48-43c0-a6ea-9487caa023ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:03.608536 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e36a16-2b48-43c0-a6ea-9487caa023ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:03.618648 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e36a16-2b48-43c0-a6ea-9487caa023ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:03.620079 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e36a16-2b48-43c0-a6ea-9487caa023ef service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:03.633491 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 534/1063] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 15:06:06.324096 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd0a37-810c-4bd4-aac6-89fdac298c2a None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:06.324702 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd0a37-810c-4bd4-aac6-89fdac298c2a None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:06.324702 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd0a37-810c-4bd4-aac6-89fdac298c2a None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:06.326793 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 530/1064] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:06:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:06.332490 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3977c-830c-4c85-ab4d-fa5f2305603e None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:06.333034 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3977c-830c-4c85-ab4d-fa5f2305603e None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:06.333034 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3977c-830c-4c85-ab4d-fa5f2305603e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:06.355219 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-c1b3977c-830c-4c85-ab4d-fa5f2305603e None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:06.356546 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-c1b3977c-830c-4c85-ab4d-fa5f2305603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:06.374700 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 535/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:06:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:06.729634 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd0a37-810c-4bd4-aac6-89fdac298c2a None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:06.740695 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd0a37-810c-4bd4-aac6-89fdac298c2a None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:06.744196 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515633d8-e447-4666-8468-ab31291d1b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:06.744791 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515633d8-e447-4666-8468-ab31291d1b8b service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:06.745072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515633d8-e447-4666-8468-ab31291d1b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:06.745344 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515633d8-e447-4666-8468-ab31291d1b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:06.755016 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515633d8-e447-4666-8468-ab31291d1b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:06.756448 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515633d8-e447-4666-8468-ab31291d1b8b service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:06.766528 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 531/1066] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:06:09.112143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1508cf6-672e-4711-a48d-99282744f3bb None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:09.112670 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1508cf6-672e-4711-a48d-99282744f3bb None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:09.112670 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1508cf6-672e-4711-a48d-99282744f3bb None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:09.114006 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 536/1067] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:09.119449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c665cf0-dc93-4f17-a2cd-07d12b8ce7c3 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:09.119847 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c665cf0-dc93-4f17-a2cd-07d12b8ce7c3 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:09.120008 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c665cf0-dc93-4f17-a2cd-07d12b8ce7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:09.141418 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-4c665cf0-dc93-4f17-a2cd-07d12b8ce7c3 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:09.142659 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-4c665cf0-dc93-4f17-a2cd-07d12b8ce7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:09.150420 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 532/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:06:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:09.503509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1508cf6-672e-4711-a48d-99282744f3bb None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:09.514605 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1508cf6-672e-4711-a48d-99282744f3bb None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:09.518172 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7d3f4-517c-47ff-bedf-8d6569613726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:09.518713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7d3f4-517c-47ff-bedf-8d6569613726 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:09.518994 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7d3f4-517c-47ff-bedf-8d6569613726 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:09.519267 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7d3f4-517c-47ff-bedf-8d6569613726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:09.529044 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7d3f4-517c-47ff-bedf-8d6569613726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:09.530533 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7d3f4-517c-47ff-bedf-8d6569613726 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:09.540300 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 537/1069] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:06:12.024976 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8e7dd-6550-4f0b-ab13-f785e79ae1af None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:12.025512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8e7dd-6550-4f0b-ab13-f785e79ae1af None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:12.025512 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8e7dd-6550-4f0b-ab13-f785e79ae1af None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:12.026965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 533/1070] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:12.032826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1c5b5-0ee6-4c85-ba41-cef93c422f61 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:12.033250 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1c5b5-0ee6-4c85-ba41-cef93c422f61 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:12.033387 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1c5b5-0ee6-4c85-ba41-cef93c422f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:12.053050 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-3eb1c5b5-0ee6-4c85-ba41-cef93c422f61 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:12.054263 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-3eb1c5b5-0ee6-4c85-ba41-cef93c422f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:12.062301 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 538/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:06:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:12.405655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8e7dd-6550-4f0b-ab13-f785e79ae1af None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:12.425044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8e7dd-6550-4f0b-ab13-f785e79ae1af None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:12.428564 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b38007-9000-4575-aa08-f76082ebe6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:12.429154 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38007-9000-4575-aa08-f76082ebe6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:12.429433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38007-9000-4575-aa08-f76082ebe6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:12.429703 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38007-9000-4575-aa08-f76082ebe6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:12.439433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b38007-9000-4575-aa08-f76082ebe6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:12.440869 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b38007-9000-4575-aa08-f76082ebe6e1 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:12.451090 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 534/1072] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:06:14.720159 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f81f16-f0c9-411e-b4d6-9fea3e0d368b None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:14.720707 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f81f16-f0c9-411e-b4d6-9fea3e0d368b None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:14.721133 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f81f16-f0c9-411e-b4d6-9fea3e0d368b None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:14.723683 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 539/1073] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:06:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:14.732134 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b76659-8e72-49cb-8292-707a01363056 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:14.732634 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b76659-8e72-49cb-8292-707a01363056 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:14.733114 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b76659-8e72-49cb-8292-707a01363056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:14.769961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-a1b76659-8e72-49cb-8292-707a01363056 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:14.771232 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-a1b76659-8e72-49cb-8292-707a01363056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:14.780561 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 535/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:06:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:15.131816 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f81f16-f0c9-411e-b4d6-9fea3e0d368b None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:15.137949 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=64 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:06:15.143656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f81f16-f0c9-411e-b4d6-9fea3e0d368b None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:15.147256 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6b181-779a-4135-8645-73e11c9d505f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:15.147894 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6b181-779a-4135-8645-73e11c9d505f service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:15.153654 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6b181-779a-4135-8645-73e11c9d505f service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:15.153654 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6b181-779a-4135-8645-73e11c9d505f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:15.158533 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6b181-779a-4135-8645-73e11c9d505f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:15.159997 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6b181-779a-4135-8645-73e11c9d505f service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:15.169553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 540/1075] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:06:17.407998 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ebff5-8764-4032-86a7-c8f3277e6b61 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:17.408600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ebff5-8764-4032-86a7-c8f3277e6b61 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:17.408600 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ebff5-8764-4032-86a7-c8f3277e6b61 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:17.409960 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 536/1076] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:17.415640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373819a-9630-4ebf-946b-45d2b976dfbf None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:17.416108 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373819a-9630-4ebf-946b-45d2b976dfbf None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:17.416211 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373819a-9630-4ebf-946b-45d2b976dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:17.435153 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-f373819a-9630-4ebf-946b-45d2b976dfbf None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:17.436348 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-f373819a-9630-4ebf-946b-45d2b976dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:17.444367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 541/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:06:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:17.793071 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ebff5-8764-4032-86a7-c8f3277e6b61 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:17.798938 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=73 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:06:17.804523 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ebff5-8764-4032-86a7-c8f3277e6b61 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:17.807976 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01912a1e-73fe-4f78-b6ce-38bcbdb012dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:17.816165 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01912a1e-73fe-4f78-b6ce-38bcbdb012dd service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:17.816165 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01912a1e-73fe-4f78-b6ce-38bcbdb012dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:17.816165 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01912a1e-73fe-4f78-b6ce-38bcbdb012dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:17.818824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01912a1e-73fe-4f78-b6ce-38bcbdb012dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:17.820295 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01912a1e-73fe-4f78-b6ce-38bcbdb012dd service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:17.830793 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 537/1078] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:06:20.078531 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c071c-7dec-4544-aa44-57f38815033a None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:20.079103 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c071c-7dec-4544-aa44-57f38815033a None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:20.079103 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c071c-7dec-4544-aa44-57f38815033a None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:20.080417 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 542/1079] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:20.085795 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48a30-47fe-416b-8f8a-640a6ae0c080 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:20.086258 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48a30-47fe-416b-8f8a-640a6ae0c080 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:20.086383 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48a30-47fe-416b-8f8a-640a6ae0c080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:20.106248 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-61e48a30-47fe-416b-8f8a-640a6ae0c080 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:20.107406 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-61e48a30-47fe-416b-8f8a-640a6ae0c080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:20.115105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 538/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:06:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:20.453299 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c071c-7dec-4544-aa44-57f38815033a None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:20.464067 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c071c-7dec-4544-aa44-57f38815033a None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:20.468048 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642be234-286e-4d9f-aa63-800712125c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:20.468643 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642be234-286e-4d9f-aa63-800712125c48 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:20.468920 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642be234-286e-4d9f-aa63-800712125c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:20.469191 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642be234-286e-4d9f-aa63-800712125c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:20.478629 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642be234-286e-4d9f-aa63-800712125c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:20.480543 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642be234-286e-4d9f-aa63-800712125c48 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:20.489826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 543/1081] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:06:22.691296 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da82802-7388-4064-a548-bb59693d8a1d None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:22.691887 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da82802-7388-4064-a548-bb59693d8a1d None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:22.691887 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da82802-7388-4064-a548-bb59693d8a1d None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:22.693195 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 539/1082] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:22.698249 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fa832-7dd8-4e3d-bf56-7b4c5379ccda None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:22.699297 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fa832-7dd8-4e3d-bf56-7b4c5379ccda None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:22.699421 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fa832-7dd8-4e3d-bf56-7b4c5379ccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:22.719734 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-cf4fa832-7dd8-4e3d-bf56-7b4c5379ccda None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:22.720922 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-cf4fa832-7dd8-4e3d-bf56-7b4c5379ccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:22.728571 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 544/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:06:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:23.064591 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da82802-7388-4064-a548-bb59693d8a1d None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:23.076792 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da82802-7388-4064-a548-bb59693d8a1d None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:23.080967 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d753c2-f80a-48eb-b0e5-7f7f917189b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:23.081578 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d753c2-f80a-48eb-b0e5-7f7f917189b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:23.081848 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d753c2-f80a-48eb-b0e5-7f7f917189b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:23.082111 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d753c2-f80a-48eb-b0e5-7f7f917189b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:23.091654 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d753c2-f80a-48eb-b0e5-7f7f917189b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:23.096340 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d753c2-f80a-48eb-b0e5-7f7f917189b6 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:23.103659 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 540/1084] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:06:25.373796 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292b9b4-5520-4bd8-a050-4f3300188942 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:25.374379 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292b9b4-5520-4bd8-a050-4f3300188942 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:25.374511 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292b9b4-5520-4bd8-a050-4f3300188942 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:25.375813 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 545/1085] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:25.381304 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173dc1f-ecd2-43e0-bdd3-0f141f3d9782 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:25.387705 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173dc1f-ecd2-43e0-bdd3-0f141f3d9782 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:25.387705 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173dc1f-ecd2-43e0-bdd3-0f141f3d9782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:25.401236 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-a173dc1f-ecd2-43e0-bdd3-0f141f3d9782 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:25.402993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-a173dc1f-ecd2-43e0-bdd3-0f141f3d9782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:25.410978 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 541/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:06:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:25.756724 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292b9b4-5520-4bd8-a050-4f3300188942 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:25.768325 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292b9b4-5520-4bd8-a050-4f3300188942 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:25.771869 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de77b5-5d51-4706-8ee7-5e935470e5a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:25.780038 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de77b5-5d51-4706-8ee7-5e935470e5a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:25.780038 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de77b5-5d51-4706-8ee7-5e935470e5a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:25.780038 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de77b5-5d51-4706-8ee7-5e935470e5a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:25.785665 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de77b5-5d51-4706-8ee7-5e935470e5a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:25.787751 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de77b5-5d51-4706-8ee7-5e935470e5a4 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:25.797838 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 546/1087] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:06:35.396235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=17 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:06:35.793435 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=23 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:06:51.092774 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c20c4-59d5-49d9-ac9f-30413adfe5c8 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:51.093370 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c20c4-59d5-49d9-ac9f-30413adfe5c8 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:51.093370 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c20c4-59d5-49d9-ac9f-30413adfe5c8 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:51.094717 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 542/1088] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:51.099794 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2aa96-8a10-4f55-8f32-2362950ac3f6 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:51.100278 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2aa96-8a10-4f55-8f32-2362950ac3f6 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:51.100394 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2aa96-8a10-4f55-8f32-2362950ac3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:51.120952 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-ffb2aa96-8a10-4f55-8f32-2362950ac3f6 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:51.122158 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-ffb2aa96-8a10-4f55-8f32-2362950ac3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:51.129942 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 547/1089] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:06:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:51.491563 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d0a48-e468-4ee6-a505-f24a8dc06f08 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:51.491878 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d0a48-e468-4ee6-a505-f24a8dc06f08 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:51.492155 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d0a48-e468-4ee6-a505-f24a8dc06f08 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:51.493746 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 543/1090] 10.222.0.52 () {54 vars in 967 bytes} [Wed Aug 31 15:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:51.500115 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fb652-6270-4c8c-8576-aea93f119bae None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:51.500405 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fb652-6270-4c8c-8576-aea93f119bae None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:51.500678 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fb652-6270-4c8c-8576-aea93f119bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:51.521753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-e69fb652-6270-4c8c-8576-aea93f119bae None None] MFA Rules not processed for user `7e0027b550fa4eaaa3f95da115d7da02`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:51.523050 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-e69fb652-6270-4c8c-8576-aea93f119bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:51.531057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 548/1091] 10.222.0.52 () {58 vars in 1064 bytes} [Wed Aug 31 15:06:51 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:51.538954 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d0a48-e468-4ee6-a505-f24a8dc06f08 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:51.553229 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d0a48-e468-4ee6-a505-f24a8dc06f08 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:51.557937 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e78081-95d3-4e37-b351-6eec0a24070b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0027b550fa4eaaa3f95da115d7da02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:51.558968 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e78081-95d3-4e37-b351-6eec0a24070b service glance] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:51.559444 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e78081-95d3-4e37-b351-6eec0a24070b service glance] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:51.559935 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e78081-95d3-4e37-b351-6eec0a24070b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:51.570398 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e78081-95d3-4e37-b351-6eec0a24070b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:51.571832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e78081-95d3-4e37-b351-6eec0a24070b service glance] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:51.582393 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 544/1092] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:06:53.910502 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90412fb5-5f1a-4b3a-b9b9-156ff1472c49 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:53.911034 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90412fb5-5f1a-4b3a-b9b9-156ff1472c49 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:53.911034 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90412fb5-5f1a-4b3a-b9b9-156ff1472c49 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:53.912391 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 549/1093] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:53.918161 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b591d6-b454-4f04-a665-0feff9010641 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:53.924248 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b591d6-b454-4f04-a665-0feff9010641 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:53.924248 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b591d6-b454-4f04-a665-0feff9010641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:53.939412 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-f6b591d6-b454-4f04-a665-0feff9010641 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:53.941192 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-f6b591d6-b454-4f04-a665-0feff9010641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:53.948589 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 545/1094] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:06:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:54.285405 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90412fb5-5f1a-4b3a-b9b9-156ff1472c49 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:54.298950 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90412fb5-5f1a-4b3a-b9b9-156ff1472c49 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:54.303841 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37331ed-2191-47f4-9b25-905b74313d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:54.304449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37331ed-2191-47f4-9b25-905b74313d95 admin admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:54.304725 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37331ed-2191-47f4-9b25-905b74313d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:54.305038 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37331ed-2191-47f4-9b25-905b74313d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:54.305628 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37331ed-2191-47f4-9b25-905b74313d95 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:54.308031 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: WARNING py.warnings [None req-e37331ed-2191-47f4-9b25-905b74313d95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:06:54.308031 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: warnings.warn(msg) Aug 31 15:06:54.308031 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: Aug 31 15:06:54.309163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37331ed-2191-47f4-9b25-905b74313d95 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:54.328807 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 550/1095] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 31 15:06:54 2022] GET /identity/v3/projects => generated 1606 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 15:06:56.606480 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d888d-b01b-4425-93fb-d7aa937b3c48 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:56.607088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d888d-b01b-4425-93fb-d7aa937b3c48 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:56.607088 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d888d-b01b-4425-93fb-d7aa937b3c48 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:56.608391 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 546/1096] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:56.614090 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2759d83-4d6c-4103-a1eb-80b3c2339373 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:56.614527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2759d83-4d6c-4103-a1eb-80b3c2339373 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:56.614685 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2759d83-4d6c-4103-a1eb-80b3c2339373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:56.633902 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-d2759d83-4d6c-4103-a1eb-80b3c2339373 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:56.635646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-d2759d83-4d6c-4103-a1eb-80b3c2339373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:56.643479 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 551/1097] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:06:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:57.000157 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d888d-b01b-4425-93fb-d7aa937b3c48 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:57.015261 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d888d-b01b-4425-93fb-d7aa937b3c48 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:57.020379 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06ff2b-99a2-469c-bdec-c90ccc14da8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:57.020989 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06ff2b-99a2-469c-bdec-c90ccc14da8e service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:57.021267 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06ff2b-99a2-469c-bdec-c90ccc14da8e service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:57.021580 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06ff2b-99a2-469c-bdec-c90ccc14da8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:57.030942 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06ff2b-99a2-469c-bdec-c90ccc14da8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:57.032514 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06ff2b-99a2-469c-bdec-c90ccc14da8e service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:57.042860 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 547/1098] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:06:59.479819 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd269c-875f-432b-93f0-3ff3b4f7fb9c None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:59.480483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd269c-875f-432b-93f0-3ff3b4f7fb9c None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:59.480483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd269c-875f-432b-93f0-3ff3b4f7fb9c None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:59.481706 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 552/1099] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:06:59.486978 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bff12-f3cc-430c-9f82-e01e96769433 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:59.487416 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bff12-f3cc-430c-9f82-e01e96769433 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:59.487535 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bff12-f3cc-430c-9f82-e01e96769433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:59.508008 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-da8bff12-f3cc-430c-9f82-e01e96769433 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:06:59.509253 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-da8bff12-f3cc-430c-9f82-e01e96769433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:06:59.518129 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 548/1100] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:06:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:06:59.862101 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd269c-875f-432b-93f0-3ff3b4f7fb9c None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:06:59.873678 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd269c-875f-432b-93f0-3ff3b4f7fb9c None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:06:59.877333 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088ead8-6a6c-4598-8fd6-eb3268caf331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:06:59.877945 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088ead8-6a6c-4598-8fd6-eb3268caf331 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:06:59.878413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088ead8-6a6c-4598-8fd6-eb3268caf331 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:06:59.878928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088ead8-6a6c-4598-8fd6-eb3268caf331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:06:59.888534 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088ead8-6a6c-4598-8fd6-eb3268caf331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:06:59.889962 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088ead8-6a6c-4598-8fd6-eb3268caf331 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:06:59.899613 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 553/1101] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:06:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:07:02.179106 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb6656-3858-496d-a14d-d996b72f1d8c None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:07:02.179650 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb6656-3858-496d-a14d-d996b72f1d8c None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:07:02.179650 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb6656-3858-496d-a14d-d996b72f1d8c None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:07:02.181603 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 549/1102] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:07:02.187029 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bceeef-a4b6-4469-b3b0-ca9857ed9212 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:07:02.187473 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bceeef-a4b6-4469-b3b0-ca9857ed9212 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:07:02.187578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bceeef-a4b6-4469-b3b0-ca9857ed9212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:07:02.208401 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-c8bceeef-a4b6-4469-b3b0-ca9857ed9212 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:07:02.209591 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-c8bceeef-a4b6-4469-b3b0-ca9857ed9212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:07:02.217982 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 554/1103] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:07:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:07:02.566049 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb6656-3858-496d-a14d-d996b72f1d8c None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:07:02.578133 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb6656-3858-496d-a14d-d996b72f1d8c None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:07:02.581723 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f1557-17ad-48a6-8655-07e00be234f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:07:02.582344 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f1557-17ad-48a6-8655-07e00be234f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:07:02.582625 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f1557-17ad-48a6-8655-07e00be234f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:07:02.582896 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f1557-17ad-48a6-8655-07e00be234f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:07:02.592524 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f1557-17ad-48a6-8655-07e00be234f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:07:02.593945 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f1557-17ad-48a6-8655-07e00be234f6 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:07:02.603815 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 550/1104] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:07:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:07:05.033884 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca620-4741-431a-985e-798366cec658 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:07:05.034489 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca620-4741-431a-985e-798366cec658 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:07:05.034600 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca620-4741-431a-985e-798366cec658 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:07:05.036048 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 555/1105] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 15:07:05.044150 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885ca8-265d-40f3-819e-ff94deb57746 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:07:05.044702 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885ca8-265d-40f3-819e-ff94deb57746 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:07:05.045014 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885ca8-265d-40f3-819e-ff94deb57746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:07:05.065822 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-2b885ca8-265d-40f3-819e-ff94deb57746 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:07:05.067092 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-2b885ca8-265d-40f3-819e-ff94deb57746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:07:05.075195 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 551/1106] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:07:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:07:05.435423 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ca620-4741-431a-985e-798366cec658 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:07:05.446149 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ca620-4741-431a-985e-798366cec658 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:07:05.450990 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5304fda-5c2e-43a2-a5ac-a4db44f3b540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:07:05.451586 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5304fda-5c2e-43a2-a5ac-a4db44f3b540 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:07:05.451867 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5304fda-5c2e-43a2-a5ac-a4db44f3b540 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:07:05.452139 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5304fda-5c2e-43a2-a5ac-a4db44f3b540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:07:05.461701 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5304fda-5c2e-43a2-a5ac-a4db44f3b540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:07:05.464000 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5304fda-5c2e-43a2-a5ac-a4db44f3b540 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:07:05.480810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 556/1107] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:07:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:07:08.258130 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51480da-f6c7-46f7-838a-5cdff6001205 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:07:08.258744 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51480da-f6c7-46f7-838a-5cdff6001205 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:07:08.258860 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51480da-f6c7-46f7-838a-5cdff6001205 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:07:08.260147 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 552/1108] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 31 15:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:07:08.266596 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d069c64-7740-4a0e-81de-db70a0aab44a None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:07:08.267340 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d069c64-7740-4a0e-81de-db70a0aab44a None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:07:08.267340 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d069c64-7740-4a0e-81de-db70a0aab44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:07:08.286922 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-3d069c64-7740-4a0e-81de-db70a0aab44a None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:07:08.288144 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-3d069c64-7740-4a0e-81de-db70a0aab44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:07:08.296847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 557/1109] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 31 15:07:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:07:08.654255 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51480da-f6c7-46f7-838a-5cdff6001205 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:07:08.665312 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51480da-f6c7-46f7-838a-5cdff6001205 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:07:08.669427 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74dba8-37bc-41bf-ad50-262d24dcea91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:07:08.670009 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74dba8-37bc-41bf-ad50-262d24dcea91 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:07:08.670286 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74dba8-37bc-41bf-ad50-262d24dcea91 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:07:08.670577 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74dba8-37bc-41bf-ad50-262d24dcea91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:07:08.679416 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74dba8-37bc-41bf-ad50-262d24dcea91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:07:08.680824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74dba8-37bc-41bf-ad50-262d24dcea91 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:07:08.690164 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 553/1110] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:07:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:07:18.281784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=33 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:07:18.686182 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=33 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:08:47.329838 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0e526-eb53-48bd-bef2-27ccffd45d87 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:47.330518 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0e526-eb53-48bd-bef2-27ccffd45d87 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:47.330518 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0e526-eb53-48bd-bef2-27ccffd45d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:47.350267 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-bcc0e526-eb53-48bd-bef2-27ccffd45d87 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:08:47.351504 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-bcc0e526-eb53-48bd-bef2-27ccffd45d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:08:47.359491 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 558/1111] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:08:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:08:47.367468 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67367e-e8f1-445d-8973-26e09204ba1f None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:47.367979 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67367e-e8f1-445d-8973-26e09204ba1f None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:47.368076 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67367e-e8f1-445d-8973-26e09204ba1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:47.387462 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-bf67367e-e8f1-445d-8973-26e09204ba1f None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:08:47.388689 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-bf67367e-e8f1-445d-8973-26e09204ba1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:08:47.396437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 554/1112] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:08:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:08:47.402382 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0e526-eb53-48bd-bef2-27ccffd45d87 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:08:47.412141 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0e526-eb53-48bd-bef2-27ccffd45d87 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:08:47.416715 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2291c76-7e53-46d7-8801-2f56ad363eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:08:47.417315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2291c76-7e53-46d7-8801-2f56ad363eee admin admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:47.417597 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2291c76-7e53-46d7-8801-2f56ad363eee admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:47.417894 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2291c76-7e53-46d7-8801-2f56ad363eee admin admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:47.418562 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2291c76-7e53-46d7-8801-2f56ad363eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 15:08:47.418868 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2291c76-7e53-46d7-8801-2f56ad363eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:08:47.419863 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: WARNING py.warnings [None req-a2291c76-7e53-46d7-8801-2f56ad363eee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:08:47.419863 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: warnings.warn(msg) Aug 31 15:08:47.419863 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: Aug 31 15:08:47.420756 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2291c76-7e53-46d7-8801-2f56ad363eee admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:08:47.432497 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 559/1113] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 31 15:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 15:08:47.440784 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67367e-e8f1-445d-8973-26e09204ba1f None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:08:47.450862 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67367e-e8f1-445d-8973-26e09204ba1f None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:08:47.455426 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dffa92-ec5a-466d-9518-130c3c9ab089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:08:47.456010 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dffa92-ec5a-466d-9518-130c3c9ab089 admin admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:47.456285 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dffa92-ec5a-466d-9518-130c3c9ab089 admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:47.456552 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dffa92-ec5a-466d-9518-130c3c9ab089 admin admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:47.457176 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dffa92-ec5a-466d-9518-130c3c9ab089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:08:47.458969 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: WARNING py.warnings [None req-58dffa92-ec5a-466d-9518-130c3c9ab089 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:08:47.458969 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: warnings.warn(msg) Aug 31 15:08:47.458969 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: Aug 31 15:08:47.460175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dffa92-ec5a-466d-9518-130c3c9ab089 admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:08:47.581079 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 555/1114] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 31 15:08:47 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 15:08:47.585280 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2291c76-7e53-46d7-8801-2f56ad363eee admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:08:47.596068 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2291c76-7e53-46d7-8801-2f56ad363eee admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:08:47.653737 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b9d12-5d9b-48a4-8eea-641ce1445cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:08:47.654364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b9d12-5d9b-48a4-8eea-641ce1445cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:47.654646 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b9d12-5d9b-48a4-8eea-641ce1445cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:47.654918 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b9d12-5d9b-48a4-8eea-641ce1445cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:47.655552 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b9d12-5d9b-48a4-8eea-641ce1445cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:08:47.656544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: WARNING py.warnings [None req-128b9d12-5d9b-48a4-8eea-641ce1445cc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:08:47.656544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: warnings.warn(msg) Aug 31 15:08:47.656544 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: Aug 31 15:08:47.657734 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b9d12-5d9b-48a4-8eea-641ce1445cc1 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:08:47.762757 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 560/1115] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 31 15:08:47 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 15:08:47.767105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dffa92-ec5a-466d-9518-130c3c9ab089 admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:08:47.778471 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dffa92-ec5a-466d-9518-130c3c9ab089 admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:08:47.783201 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450d24d-d64f-4899-8ac6-64784f7f33fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:08:47.783808 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450d24d-d64f-4899-8ac6-64784f7f33fc admin admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:47.784118 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450d24d-d64f-4899-8ac6-64784f7f33fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:47.784395 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450d24d-d64f-4899-8ac6-64784f7f33fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:47.785069 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450d24d-d64f-4899-8ac6-64784f7f33fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:08:47.786087 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: WARNING py.warnings [None req-c450d24d-d64f-4899-8ac6-64784f7f33fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:08:47.786087 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: warnings.warn(msg) Aug 31 15:08:47.786087 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: Aug 31 15:08:47.787019 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450d24d-d64f-4899-8ac6-64784f7f33fc admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:08:47.800836 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 556/1116] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 31 15:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 15:08:47.805312 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b9d12-5d9b-48a4-8eea-641ce1445cc1 admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:08:47.815987 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b9d12-5d9b-48a4-8eea-641ce1445cc1 admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:08:47.820679 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bae381-aca2-4461-bdeb-6e6db52f1320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:08:47.821267 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bae381-aca2-4461-bdeb-6e6db52f1320 admin admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:47.823422 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bae381-aca2-4461-bdeb-6e6db52f1320 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:47.823422 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bae381-aca2-4461-bdeb-6e6db52f1320 admin admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:47.823422 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bae381-aca2-4461-bdeb-6e6db52f1320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:08:47.824308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: WARNING py.warnings [None req-74bae381-aca2-4461-bdeb-6e6db52f1320 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:08:47.824308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: warnings.warn(msg) Aug 31 15:08:47.824308 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: Aug 31 15:08:47.825527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bae381-aca2-4461-bdeb-6e6db52f1320 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:08:47.839709 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 561/1117] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 31 15:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 15:08:47.843786 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450d24d-d64f-4899-8ac6-64784f7f33fc admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:08:47.854223 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450d24d-d64f-4899-8ac6-64784f7f33fc admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:08:47.859026 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c33aba-7d9a-4da9-8c45-358e0396b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:08:47.859712 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c33aba-7d9a-4da9-8c45-358e0396b640 admin admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:47.859994 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c33aba-7d9a-4da9-8c45-358e0396b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:47.860271 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c33aba-7d9a-4da9-8c45-358e0396b640 admin admin] PATH_INFO: `/v3/projects/732bff698f4441d8b4874a2cb3d6a70e/users/a652ff84b4cd4d859dbd498d2639a9d1/roles/807b71faee4a435e95e2ca3296e64c2e` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:47.876235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c33aba-7d9a-4da9-8c45-358e0396b640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732bff698f4441d8b4874a2cb3d6a70e, user_id=a652ff84b4cd4d859dbd498d2639a9d1, role_id=807b71faee4a435e95e2ca3296e64c2e)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:08:47.877272 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: WARNING py.warnings [None req-34c33aba-7d9a-4da9-8c45-358e0396b640 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:08:47.877272 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: warnings.warn(msg) Aug 31 15:08:47.877272 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: Aug 31 15:08:47.879274 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c33aba-7d9a-4da9-8c45-358e0396b640 admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:08:47.962750 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 557/1118] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 31 15:08:47 2022] PUT /identity/v3/projects/732bff698f4441d8b4874a2cb3d6a70e/users/a652ff84b4cd4d859dbd498d2639a9d1/roles/807b71faee4a435e95e2ca3296e64c2e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:08:47.975278 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa116668-0a95-4b58-b0e9-63758d528c1b None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:47.975564 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa116668-0a95-4b58-b0e9-63758d528c1b None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:47.975860 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa116668-0a95-4b58-b0e9-63758d528c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:48.005674 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-fa116668-0a95-4b58-b0e9-63758d528c1b None None] MFA Rules not processed for user `a652ff84b4cd4d859dbd498d2639a9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:08:48.007022 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-fa116668-0a95-4b58-b0e9-63758d528c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:08:48.072988 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 562/1119] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:08:47 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:08:48.086132 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb072d2-d14f-4685-beba-6b6e408b6b4c None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:48.086456 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb072d2-d14f-4685-beba-6b6e408b6b4c None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:48.086734 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb072d2-d14f-4685-beba-6b6e408b6b4c None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:48.088540 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 558/1120] 10.222.0.52 () {54 vars in 964 bytes} [Wed Aug 31 15:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:08:48.093485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846290e-db60-482f-aed8-d8197278f6de None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:48.093716 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846290e-db60-482f-aed8-d8197278f6de None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:48.093989 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846290e-db60-482f-aed8-d8197278f6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:48.114801 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-b846290e-db60-482f-aed8-d8197278f6de None None] MFA Rules not processed for user `1308dea6ef324bf388a0339ca911f36c`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:08:48.116118 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-b846290e-db60-482f-aed8-d8197278f6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:08:48.159477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:08:48.167247 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 563/1121] 10.222.0.52 () {58 vars in 1061 bytes} [Wed Aug 31 15:08:48 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:08:48.175146 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb072d2-d14f-4685-beba-6b6e408b6b4c None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:08:48.186603 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb072d2-d14f-4685-beba-6b6e408b6b4c None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:08:48.190663 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfb721-a7d3-4589-acbd-9cfab13fe624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1308dea6ef324bf388a0339ca911f36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:08:48.191254 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfb721-a7d3-4589-acbd-9cfab13fe624 service cinder] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:48.191529 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfb721-a7d3-4589-acbd-9cfab13fe624 service cinder] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:48.191795 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfb721-a7d3-4589-acbd-9cfab13fe624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:48.200493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfb721-a7d3-4589-acbd-9cfab13fe624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:08:48.201916 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfb721-a7d3-4589-acbd-9cfab13fe624 service cinder] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:08:48.210605 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 559/1122] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:08:48 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:08:48.249514 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7b2c-7a1b-4702-939c-7c5297317913 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:48.249800 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7b2c-7a1b-4702-939c-7c5297317913 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:48.250075 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7b2c-7a1b-4702-939c-7c5297317913 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:48.251356 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 564/1123] 10.222.0.52 () {52 vars in 830 bytes} [Wed Aug 31 15:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:08:48.254968 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfb721-a7d3-4589-acbd-9cfab13fe624 service cinder] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:08:48.316942 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfb721-a7d3-4589-acbd-9cfab13fe624 service cinder] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:08:48.321711 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:08:48.322345 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:48.322625 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:48.322893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] PATH_INFO: `/v3/users/a652ff84b4cd4d859dbd498d2639a9d1` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:48.324015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a652ff84b4cd4d859dbd498d2639a9d1)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:08:48.325023 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: WARNING py.warnings [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:08:48.325023 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: warnings.warn(msg) Aug 31 15:08:48.325023 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: Aug 31 15:08:48.326235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:08:48.594870 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a652ff84b4cd4d859dbd498d2639a9d1'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:08:48.658382 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a652ff84b4cd4d859dbd498d2639a9d1'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:08:48.658994 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a652ff84b4cd4d859dbd498d2639a9d1'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:08:48.674633 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a652ff84b4cd4d859dbd498d2639a9d1'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:08:48.675385 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a652ff84b4cd4d859dbd498d2639a9d1'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:08:48.696841 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:08:48.704373 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 560/1124] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 31 15:08:48 2022] DELETE /identity/v3/users/a652ff84b4cd4d859dbd498d2639a9d1 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:08:48.708912 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63119c-7967-4fdd-b3ce-d37251938a13 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:48.709404 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63119c-7967-4fdd-b3ce-d37251938a13 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:48.709509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63119c-7967-4fdd-b3ce-d37251938a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:48.729408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-9a63119c-7967-4fdd-b3ce-d37251938a13 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:08:48.730638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-9a63119c-7967-4fdd-b3ce-d37251938a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:08:48.790547 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 565/1125] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:08:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:08:48.800797 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:08:48.802201 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:08:48.861434 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9435d6-3c72-4893-a464-c333d0df4c98 admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:08:48.865058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c7295-24d3-46fd-8f4c-ab7d8ce8e740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:08:48.865671 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7295-24d3-46fd-8f4c-ab7d8ce8e740 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:48.865951 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7295-24d3-46fd-8f4c-ab7d8ce8e740 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:48.866219 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7295-24d3-46fd-8f4c-ab7d8ce8e740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:48.875763 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c7295-24d3-46fd-8f4c-ab7d8ce8e740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:08:48.877229 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c7295-24d3-46fd-8f4c-ab7d8ce8e740 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:08:48.887082 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 561/1126] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:08:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 15:08:49.409227 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63119c-7967-4fdd-b3ce-d37251938a13 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:08:49.410837 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-9a63119c-7967-4fdd-b3ce-d37251938a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:08:49.423525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63119c-7967-4fdd-b3ce-d37251938a13 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:08:49.428177 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:08:49.428805 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:08:49.429084 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:08:49.429355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] PATH_INFO: `/v3/projects/732bff698f4441d8b4874a2cb3d6a70e` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:08:49.430545 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=732bff698f4441d8b4874a2cb3d6a70e)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:08:49.432129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: WARNING py.warnings [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:08:49.432129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: warnings.warn(msg) Aug 31 15:08:49.432129 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: Aug 31 15:08:49.433432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:08:49.537903 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732bff698f4441d8b4874a2cb3d6a70e', 'request_id': 'req-f4245878-7542-4376-99ea-a62be3828408'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:08:49.595629 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732bff698f4441d8b4874a2cb3d6a70e', 'request_id': 'req-f4245878-7542-4376-99ea-a62be3828408'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:08:49.610561 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732bff698f4441d8b4874a2cb3d6a70e', 'request_id': 'req-f4245878-7542-4376-99ea-a62be3828408'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:08:49.622258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] The token cache is being invalidate because project 732bff698f4441d8b4874a2cb3d6a70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88467) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 15:08:49.622578 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:08:49.623326 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-f4245878-7542-4376-99ea-a62be3828408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:08:49.624819 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 566/1127] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 31 15:08:49 2022] DELETE /identity/v3/projects/732bff698f4441d8b4874a2cb3d6a70e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:08:58.882450 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:08:59.618539 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:10:17.642126 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623cb25-b22e-42b0-a9df-7bf7eb88963b None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:17.642797 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623cb25-b22e-42b0-a9df-7bf7eb88963b None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:17.642797 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623cb25-b22e-42b0-a9df-7bf7eb88963b None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:17.644067 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 562/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 15:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:10:17.649477 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f8acb-9b68-4838-8951-22674964ddd7 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:17.649899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f8acb-9b68-4838-8951-22674964ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:17.650037 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f8acb-9b68-4838-8951-22674964ddd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:17.670190 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-ac2f8acb-9b68-4838-8951-22674964ddd7 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:10:17.671475 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-ac2f8acb-9b68-4838-8951-22674964ddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:17.730860 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 567/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 15:10:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:10:17.891360 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623cb25-b22e-42b0-a9df-7bf7eb88963b None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:10:17.899024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-3623cb25-b22e-42b0-a9df-7bf7eb88963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:17.967689 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623cb25-b22e-42b0-a9df-7bf7eb88963b None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:10:17.972608 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e557324-be80-4ea1-9139-ddd649eeecc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:10:17.973213 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e557324-be80-4ea1-9139-ddd649eeecc3 service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:17.973491 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e557324-be80-4ea1-9139-ddd649eeecc3 service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:17.973762 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e557324-be80-4ea1-9139-ddd649eeecc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:17.982358 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e557324-be80-4ea1-9139-ddd649eeecc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:10:17.983941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e557324-be80-4ea1-9139-ddd649eeecc3 service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:10:17.993283 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 563/1130] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:10:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:10:18.836770 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7730-2472-4eb6-a444-16cd685d43e7 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:18.837355 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7730-2472-4eb6-a444-16cd685d43e7 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:18.837460 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7730-2472-4eb6-a444-16cd685d43e7 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:18.838827 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 568/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 15:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:10:18.844034 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe080df0-d3f9-4bbe-bf02-939ab01a6b00 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:18.844449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe080df0-d3f9-4bbe-bf02-939ab01a6b00 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:18.844632 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe080df0-d3f9-4bbe-bf02-939ab01a6b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:18.864960 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-fe080df0-d3f9-4bbe-bf02-939ab01a6b00 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:10:18.866250 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-fe080df0-d3f9-4bbe-bf02-939ab01a6b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:18.874177 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 564/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 15:10:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:10:19.032520 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7730-2472-4eb6-a444-16cd685d43e7 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:10:19.045777 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7730-2472-4eb6-a444-16cd685d43e7 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:10:19.050801 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db628661-0e06-423e-8c3b-1cc80f1f5f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:10:19.051390 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db628661-0e06-423e-8c3b-1cc80f1f5f10 service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:19.051666 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db628661-0e06-423e-8c3b-1cc80f1f5f10 service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:19.051935 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db628661-0e06-423e-8c3b-1cc80f1f5f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:19.060125 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db628661-0e06-423e-8c3b-1cc80f1f5f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:10:19.061688 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db628661-0e06-423e-8c3b-1cc80f1f5f10 service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:10:19.071410 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 569/1133] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:10:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:10:23.241043 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b100-bead-4e83-b81a-aebfec7a1e3c None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:23.241606 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b100-bead-4e83-b81a-aebfec7a1e3c None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:23.241857 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b100-bead-4e83-b81a-aebfec7a1e3c None None] PATH_INFO: `/v3` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:23.243183 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 565/1134] 10.222.0.55 () {54 vars in 925 bytes} [Wed Aug 31 15:10:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 15:10:23.249147 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37342a1d-00c3-43ec-8b3d-35ad2cc20fcd None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:23.249602 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37342a1d-00c3-43ec-8b3d-35ad2cc20fcd None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:23.249713 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37342a1d-00c3-43ec-8b3d-35ad2cc20fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:23.281357 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-37342a1d-00c3-43ec-8b3d-35ad2cc20fcd None None] MFA Rules not processed for user `63cdd2ef65aa46fab70d0d09b7d7d17c`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:10:23.282613 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-37342a1d-00c3-43ec-8b3d-35ad2cc20fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:23.345712 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 570/1135] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Aug 31 15:10:23 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:10:28.859936 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=35 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:10:30.313111 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3410039-f23f-449a-94b9-881538f5bda1 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:30.313775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3410039-f23f-449a-94b9-881538f5bda1 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:30.313775 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3410039-f23f-449a-94b9-881538f5bda1 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:30.315690 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 566/1136] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 15:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:10:30.321573 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b167-7aa2-4741-b3d4-07d5126a96df None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:30.322095 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b167-7aa2-4741-b3d4-07d5126a96df None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:30.322095 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b167-7aa2-4741-b3d4-07d5126a96df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:30.344530 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-34f2b167-7aa2-4741-b3d4-07d5126a96df None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:10:30.345918 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-34f2b167-7aa2-4741-b3d4-07d5126a96df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:30.354017 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 571/1137] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 15:10:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:10:30.515826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3410039-f23f-449a-94b9-881538f5bda1 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:10:30.530384 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3410039-f23f-449a-94b9-881538f5bda1 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:10:30.535552 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b106f9-4362-4de4-b8b4-7dbead51c8a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:10:30.538161 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b106f9-4362-4de4-b8b4-7dbead51c8a5 service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:30.538161 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b106f9-4362-4de4-b8b4-7dbead51c8a5 service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:30.538161 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b106f9-4362-4de4-b8b4-7dbead51c8a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:30.545340 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b106f9-4362-4de4-b8b4-7dbead51c8a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:10:30.547094 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b106f9-4362-4de4-b8b4-7dbead51c8a5 service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:10:30.556723 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 567/1138] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:10:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:10:31.381487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723add8-1f32-41d9-aaeb-7b9e3ee3c116 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:31.382065 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723add8-1f32-41d9-aaeb-7b9e3ee3c116 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:31.382266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723add8-1f32-41d9-aaeb-7b9e3ee3c116 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:31.383651 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 572/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 15:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:10:31.388459 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ffa4a-f61e-49a3-90aa-710adf2e4ab3 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:31.388876 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ffa4a-f61e-49a3-90aa-710adf2e4ab3 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:31.388991 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ffa4a-f61e-49a3-90aa-710adf2e4ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:31.408784 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-799ffa4a-f61e-49a3-90aa-710adf2e4ab3 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:10:31.409990 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-799ffa4a-f61e-49a3-90aa-710adf2e4ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:31.418597 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 568/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 15:10:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:10:31.575757 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723add8-1f32-41d9-aaeb-7b9e3ee3c116 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:10:31.590494 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723add8-1f32-41d9-aaeb-7b9e3ee3c116 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:10:31.596322 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3115319-d208-41af-80a9-f308d889d649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:10:31.596913 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3115319-d208-41af-80a9-f308d889d649 service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:31.597185 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3115319-d208-41af-80a9-f308d889d649 service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:31.597453 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3115319-d208-41af-80a9-f308d889d649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:31.606145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3115319-d208-41af-80a9-f308d889d649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:10:31.607728 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3115319-d208-41af-80a9-f308d889d649 service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:10:31.617219 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 573/1141] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:10:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:10:32.643625 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fda44-3849-403f-b44a-df52481bce14 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:32.644148 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fda44-3849-403f-b44a-df52481bce14 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:32.644148 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fda44-3849-403f-b44a-df52481bce14 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:32.645414 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 569/1142] 10.222.0.52 () {54 vars in 961 bytes} [Wed Aug 31 15:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 15:10:32.650785 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0083-8e33-4ccd-965b-e7d939c26a56 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:32.651230 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0083-8e33-4ccd-965b-e7d939c26a56 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:32.651335 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0083-8e33-4ccd-965b-e7d939c26a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:32.670941 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-4ffd0083-8e33-4ccd-965b-e7d939c26a56 None None] MFA Rules not processed for user `63cdd2ef65aa46fab70d0d09b7d7d17c`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:10:32.672134 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-4ffd0083-8e33-4ccd-965b-e7d939c26a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:32.681496 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 574/1143] 10.222.0.52 () {58 vars in 1058 bytes} [Wed Aug 31 15:10:32 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:10:32.752810 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fda44-3849-403f-b44a-df52481bce14 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:10:32.766644 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fda44-3849-403f-b44a-df52481bce14 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:10:32.771563 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82434976-3b19-4467-89c0-f343d8eed445 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63cdd2ef65aa46fab70d0d09b7d7d17c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:10:32.772377 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82434976-3b19-4467-89c0-f343d8eed445 service placement] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:32.772828 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82434976-3b19-4467-89c0-f343d8eed445 service placement] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:32.773107 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82434976-3b19-4467-89c0-f343d8eed445 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:32.781241 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82434976-3b19-4467-89c0-f343d8eed445 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:10:32.782893 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82434976-3b19-4467-89c0-f343d8eed445 service placement] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:10:32.794880 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 570/1144] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:10:32 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 15:10:35.827806 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a767a0-32f4-4d4e-80fd-f914c18b31c9 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:35.828503 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a767a0-32f4-4d4e-80fd-f914c18b31c9 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:35.828503 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a767a0-32f4-4d4e-80fd-f914c18b31c9 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:35.829678 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 575/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:10:35.835935 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885143d-3853-44f1-b350-dbf7557b849f None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:35.836900 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885143d-3853-44f1-b350-dbf7557b849f None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:35.836900 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885143d-3853-44f1-b350-dbf7557b849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:35.857061 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-2885143d-3853-44f1-b350-dbf7557b849f None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:10:35.858269 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-2885143d-3853-44f1-b350-dbf7557b849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:35.866663 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 571/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:10:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:10:36.223437 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a767a0-32f4-4d4e-80fd-f914c18b31c9 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:10:36.225126 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-91a767a0-32f4-4d4e-80fd-f914c18b31c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:36.276353 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:10:36.282522 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a767a0-32f4-4d4e-80fd-f914c18b31c9 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:10:36.285587 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032bc3e-511f-4b86-949a-895fb9f8493f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:10:36.286199 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032bc3e-511f-4b86-949a-895fb9f8493f service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:36.286526 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032bc3e-511f-4b86-949a-895fb9f8493f service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:36.286800 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032bc3e-511f-4b86-949a-895fb9f8493f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:36.295757 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032bc3e-511f-4b86-949a-895fb9f8493f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:10:36.297166 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032bc3e-511f-4b86-949a-895fb9f8493f service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:10:36.307127 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 576/1147] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:10:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:10:38.476443 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f08561-1a4a-46e0-88cd-a4c05ef0ce42 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:38.477040 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f08561-1a4a-46e0-88cd-a4c05ef0ce42 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:38.477040 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f08561-1a4a-46e0-88cd-a4c05ef0ce42 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:38.478216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 572/1148] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:10:38.483487 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb822c5d-2d4d-4c4d-8176-2fd094cc4785 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:38.483892 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb822c5d-2d4d-4c4d-8176-2fd094cc4785 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:38.484042 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb822c5d-2d4d-4c4d-8176-2fd094cc4785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:38.504148 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-eb822c5d-2d4d-4c4d-8176-2fd094cc4785 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:10:38.505338 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-eb822c5d-2d4d-4c4d-8176-2fd094cc4785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:38.513167 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 577/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:10:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:10:38.852200 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f08561-1a4a-46e0-88cd-a4c05ef0ce42 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:10:38.863059 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f08561-1a4a-46e0-88cd-a4c05ef0ce42 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:10:38.867249 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649abe6-2e8e-4116-a63d-6d27f0809dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:10:38.867869 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649abe6-2e8e-4116-a63d-6d27f0809dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:38.868146 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649abe6-2e8e-4116-a63d-6d27f0809dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:38.868419 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649abe6-2e8e-4116-a63d-6d27f0809dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:38.877444 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649abe6-2e8e-4116-a63d-6d27f0809dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:10:38.878953 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649abe6-2e8e-4116-a63d-6d27f0809dc9 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:10:38.889043 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 573/1150] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:10:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:10:43.313244 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aeddc-21be-41b2-8aca-550b78ac37cd None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:43.313773 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aeddc-21be-41b2-8aca-550b78ac37cd None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:43.313773 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aeddc-21be-41b2-8aca-550b78ac37cd None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:43.315140 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 578/1151] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:10:43.320449 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e076cd-b769-459b-93b7-9e731caac7c9 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:43.320871 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e076cd-b769-459b-93b7-9e731caac7c9 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:43.320987 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e076cd-b769-459b-93b7-9e731caac7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:43.341965 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-86e076cd-b769-459b-93b7-9e731caac7c9 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:10:43.343219 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-86e076cd-b769-459b-93b7-9e731caac7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:43.351824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 574/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:10:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:10:43.927472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3aeddc-21be-41b2-8aca-550b78ac37cd None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:10:43.933812 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-4c3aeddc-21be-41b2-8aca-550b78ac37cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:43.986928 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3aeddc-21be-41b2-8aca-550b78ac37cd None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:10:43.990432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f5947-268a-4b23-a8f6-4753e71b3acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1308dea6ef324bf388a0339ca911f36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:10:43.991036 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f5947-268a-4b23-a8f6-4753e71b3acd service cinder] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:43.992102 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f5947-268a-4b23-a8f6-4753e71b3acd service cinder] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:43.992483 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f5947-268a-4b23-a8f6-4753e71b3acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:44.001603 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f5947-268a-4b23-a8f6-4753e71b3acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:10:44.003108 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f5947-268a-4b23-a8f6-4753e71b3acd service cinder] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:10:44.012527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 579/1153] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:10:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:10:46.234481 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca9097-6b54-4b58-b98e-9a71461febe2 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:46.235045 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca9097-6b54-4b58-b98e-9a71461febe2 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:46.235045 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca9097-6b54-4b58-b98e-9a71461febe2 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:46.236409 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 575/1154] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 15:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:10:46.242317 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e9df-c99a-4f58-a799-afa29241b341 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:46.242726 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e9df-c99a-4f58-a799-afa29241b341 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:46.242968 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e9df-c99a-4f58-a799-afa29241b341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:46.262017 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-81f5e9df-c99a-4f58-a799-afa29241b341 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:10:46.263238 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-81f5e9df-c99a-4f58-a799-afa29241b341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:46.270909 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 580/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 15:10:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:10:46.845733 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca9097-6b54-4b58-b98e-9a71461febe2 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:10:46.847463 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-88ca9097-6b54-4b58-b98e-9a71461febe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:10:46.861035 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca9097-6b54-4b58-b98e-9a71461febe2 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:10:46.864621 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed04a4-4847-43bb-83c1-76629e85ceca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1308dea6ef324bf388a0339ca911f36c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:10:46.865215 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed04a4-4847-43bb-83c1-76629e85ceca service cinder] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:10:46.865495 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed04a4-4847-43bb-83c1-76629e85ceca service cinder] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:10:46.865808 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed04a4-4847-43bb-83c1-76629e85ceca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:10:46.875242 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed04a4-4847-43bb-83c1-76629e85ceca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:10:46.876721 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed04a4-4847-43bb-83c1-76629e85ceca service cinder] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:10:46.887312 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 576/1156] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:10:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:10:56.256621 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=37 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:10:56.882092 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=33 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:12:03.263861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d76c5-0603-456e-9e15-3a5544dc8ded None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.264525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d76c5-0603-456e-9e15-3a5544dc8ded None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.264525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d76c5-0603-456e-9e15-3a5544dc8ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.279058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584da8cd-d72a-41c6-824c-bcb470dfded3 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.279629 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584da8cd-d72a-41c6-824c-bcb470dfded3 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.279629 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584da8cd-d72a-41c6-824c-bcb470dfded3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.284384 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-4f8d76c5-0603-456e-9e15-3a5544dc8ded None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:03.285591 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-4f8d76c5-0603-456e-9e15-3a5544dc8ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:03.293720 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 581/1157] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:12:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:12:03.299583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-584da8cd-d72a-41c6-824c-bcb470dfded3 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:03.300793 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-584da8cd-d72a-41c6-824c-bcb470dfded3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:03.301810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b655210-55bd-41b2-8c59-54465a615057 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.302096 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b655210-55bd-41b2-8c59-54465a615057 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.302399 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b655210-55bd-41b2-8c59-54465a615057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.308594 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 577/1158] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:12:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:12:03.317513 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff8be8-f18d-4a09-b69a-c13ebfedbbb4 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.317800 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff8be8-f18d-4a09-b69a-c13ebfedbbb4 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.318076 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff8be8-f18d-4a09-b69a-c13ebfedbbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.322133 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-6b655210-55bd-41b2-8c59-54465a615057 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:03.323352 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-6b655210-55bd-41b2-8c59-54465a615057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:03.332099 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 582/1159] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:12:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:12:03.336779 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b655210-55bd-41b2-8c59-54465a615057 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:03.340444 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-39ff8be8-f18d-4a09-b69a-c13ebfedbbb4 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:03.341643 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-39ff8be8-f18d-4a09-b69a-c13ebfedbbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:03.346035 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b655210-55bd-41b2-8c59-54465a615057 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:03.350071 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 578/1160] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:12:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:12:03.350815 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba04dae-e0e7-4a4b-ba5e-fbed1886c0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:03.351411 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba04dae-e0e7-4a4b-ba5e-fbed1886c0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.351687 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba04dae-e0e7-4a4b-ba5e-fbed1886c0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.351958 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba04dae-e0e7-4a4b-ba5e-fbed1886c0f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.352597 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba04dae-e0e7-4a4b-ba5e-fbed1886c0f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88467) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 15:12:03.352896 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba04dae-e0e7-4a4b-ba5e-fbed1886c0f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:03.354491 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba04dae-e0e7-4a4b-ba5e-fbed1886c0f0 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:03.354620 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff8be8-f18d-4a09-b69a-c13ebfedbbb4 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:03.364610 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff8be8-f18d-4a09-b69a-c13ebfedbbb4 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:03.373533 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 583/1161] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 31 15:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 15:12:03.373774 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fee855-9529-4317-a991-b8b7fe7b64a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:03.373774 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fee855-9529-4317-a991-b8b7fe7b64a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.373774 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fee855-9529-4317-a991-b8b7fe7b64a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.373774 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fee855-9529-4317-a991-b8b7fe7b64a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.374123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fee855-9529-4317-a991-b8b7fe7b64a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88468) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 15:12:03.374123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fee855-9529-4317-a991-b8b7fe7b64a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:03.374123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: WARNING py.warnings [None req-89fee855-9529-4317-a991-b8b7fe7b64a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:12:03.374123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: warnings.warn(msg) Aug 31 15:12:03.374123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: Aug 31 15:12:03.374123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fee855-9529-4317-a991-b8b7fe7b64a6 admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:03.375526 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba04dae-e0e7-4a4b-ba5e-fbed1886c0f0 admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:03.385178 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba04dae-e0e7-4a4b-ba5e-fbed1886c0f0 admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:03.391394 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 579/1162] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 31 15:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 15:12:03.391600 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae991e4-e833-4ef6-afb7-5349f6ecc16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:03.391600 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae991e4-e833-4ef6-afb7-5349f6ecc16e admin admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.391600 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae991e4-e833-4ef6-afb7-5349f6ecc16e admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.391600 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae991e4-e833-4ef6-afb7-5349f6ecc16e admin admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.392266 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae991e4-e833-4ef6-afb7-5349f6ecc16e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:03.393181 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: WARNING py.warnings [None req-dae991e4-e833-4ef6-afb7-5349f6ecc16e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:12:03.393181 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: warnings.warn(msg) Aug 31 15:12:03.393181 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: Aug 31 15:12:03.394381 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae991e4-e833-4ef6-afb7-5349f6ecc16e admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:03.398148 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fee855-9529-4317-a991-b8b7fe7b64a6 admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:03.408517 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fee855-9529-4317-a991-b8b7fe7b64a6 admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:03.414493 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1814bda-b177-4cef-9d6b-b5581595aaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:03.420046 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1814bda-b177-4cef-9d6b-b5581595aaec admin admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.420046 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1814bda-b177-4cef-9d6b-b5581595aaec admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.420046 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1814bda-b177-4cef-9d6b-b5581595aaec admin admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.420046 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1814bda-b177-4cef-9d6b-b5581595aaec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:03.420046 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1814bda-b177-4cef-9d6b-b5581595aaec admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:03.509039 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 584/1163] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 31 15:12:03 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 15:12:03.513044 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae991e4-e833-4ef6-afb7-5349f6ecc16e admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:03.574836 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae991e4-e833-4ef6-afb7-5349f6ecc16e admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:03.580405 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80cb4-7c39-418f-b6c2-2a0337d37e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:03.581184 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80cb4-7c39-418f-b6c2-2a0337d37e8a admin admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.590522 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80cb4-7c39-418f-b6c2-2a0337d37e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.590522 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80cb4-7c39-418f-b6c2-2a0337d37e8a admin admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.590522 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80cb4-7c39-418f-b6c2-2a0337d37e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:03.590522 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80cb4-7c39-418f-b6c2-2a0337d37e8a admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:03.590982 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 580/1164] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 31 15:12:03 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 15:12:03.593976 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1814bda-b177-4cef-9d6b-b5581595aaec admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:03.656817 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1814bda-b177-4cef-9d6b-b5581595aaec admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:03.661757 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4fc92-f45b-4664-85fd-1a5f8ebe6803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:03.662429 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4fc92-f45b-4664-85fd-1a5f8ebe6803 admin admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.662709 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4fc92-f45b-4664-85fd-1a5f8ebe6803 admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.662980 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4fc92-f45b-4664-85fd-1a5f8ebe6803 admin admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.663606 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4fc92-f45b-4664-85fd-1a5f8ebe6803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:03.664638 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: WARNING py.warnings [None req-8ff4fc92-f45b-4664-85fd-1a5f8ebe6803 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:12:03.664638 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: warnings.warn(msg) Aug 31 15:12:03.664638 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: Aug 31 15:12:03.665867 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4fc92-f45b-4664-85fd-1a5f8ebe6803 admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:03.701824 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 585/1165] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 31 15:12:03 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 15:12:03.706277 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80cb4-7c39-418f-b6c2-2a0337d37e8a admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:03.716149 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80cb4-7c39-418f-b6c2-2a0337d37e8a admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:03.721826 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b5e9c-366e-44c7-8714-dc20ab085c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:03.722473 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b5e9c-366e-44c7-8714-dc20ab085c57 admin admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.722755 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b5e9c-366e-44c7-8714-dc20ab085c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.723025 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b5e9c-366e-44c7-8714-dc20ab085c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.723657 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b5e9c-366e-44c7-8714-dc20ab085c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:03.725229 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b5e9c-366e-44c7-8714-dc20ab085c57 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:03.735319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 586/1166] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 31 15:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 15:12:03.739280 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b5e9c-366e-44c7-8714-dc20ab085c57 admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:03.749998 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b5e9c-366e-44c7-8714-dc20ab085c57 admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:03.755082 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85de34-f452-49da-b791-d6dc62be79a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:03.755705 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85de34-f452-49da-b791-d6dc62be79a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.755984 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85de34-f452-49da-b791-d6dc62be79a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.756258 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85de34-f452-49da-b791-d6dc62be79a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.756918 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85de34-f452-49da-b791-d6dc62be79a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:03.758606 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85de34-f452-49da-b791-d6dc62be79a1 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:03.769958 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 587/1167] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 31 15:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 15:12:03.774057 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85de34-f452-49da-b791-d6dc62be79a1 admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:03.783848 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85de34-f452-49da-b791-d6dc62be79a1 admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:03.788444 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427c6aa-c036-4c8c-9a09-9e17e397313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:03.789068 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427c6aa-c036-4c8c-9a09-9e17e397313b admin admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.789347 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427c6aa-c036-4c8c-9a09-9e17e397313b admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.789618 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427c6aa-c036-4c8c-9a09-9e17e397313b admin admin] PATH_INFO: `/v3/projects/d413ea97608e4bf3afbc8a45e209c7a7/users/94bd427e4e21457e8f643095172868c7/roles/807b71faee4a435e95e2ca3296e64c2e` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.800311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 581/1168] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 31 15:12:03 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 15:12:03.804405 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4fc92-f45b-4664-85fd-1a5f8ebe6803 admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:03.804549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427c6aa-c036-4c8c-9a09-9e17e397313b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d413ea97608e4bf3afbc8a45e209c7a7, user_id=94bd427e4e21457e8f643095172868c7, role_id=807b71faee4a435e95e2ca3296e64c2e)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:03.805472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: WARNING py.warnings [None req-b427c6aa-c036-4c8c-9a09-9e17e397313b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:12:03.805472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: warnings.warn(msg) Aug 31 15:12:03.805472 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: Aug 31 15:12:03.807427 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427c6aa-c036-4c8c-9a09-9e17e397313b admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:03.815341 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4fc92-f45b-4664-85fd-1a5f8ebe6803 admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:03.820167 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe03e3-bf63-444e-86e4-d6619b325b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:03.825386 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe03e3-bf63-444e-86e4-d6619b325b6e admin admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.825386 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe03e3-bf63-444e-86e4-d6619b325b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.825386 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe03e3-bf63-444e-86e4-d6619b325b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.825386 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe03e3-bf63-444e-86e4-d6619b325b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:03.825386 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe03e3-bf63-444e-86e4-d6619b325b6e admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:03.835445 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 582/1169] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 31 15:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 15:12:03.839813 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe03e3-bf63-444e-86e4-d6619b325b6e admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:03.853017 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe03e3-bf63-444e-86e4-d6619b325b6e admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:03.858592 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1215e99-d542-4507-a9c1-775ebfb50986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:03.859510 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1215e99-d542-4507-a9c1-775ebfb50986 admin admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.859873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1215e99-d542-4507-a9c1-775ebfb50986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.860150 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1215e99-d542-4507-a9c1-775ebfb50986 admin admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.860824 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1215e99-d542-4507-a9c1-775ebfb50986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:03.862487 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1215e99-d542-4507-a9c1-775ebfb50986 admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:03.873651 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 583/1170] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 31 15:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 15:12:03.878695 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1215e99-d542-4507-a9c1-775ebfb50986 admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:03.888814 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1215e99-d542-4507-a9c1-775ebfb50986 admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:03.895063 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55151b-a8ad-49b3-a11d-870dfb109d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:03.895715 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55151b-a8ad-49b3-a11d-870dfb109d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.895994 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55151b-a8ad-49b3-a11d-870dfb109d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.896271 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55151b-a8ad-49b3-a11d-870dfb109d4d admin admin] PATH_INFO: `/v3/projects/b0580c993c824eca809a43afee13c505/users/6056231e2f4c48e099425bb4f0454061/roles/807b71faee4a435e95e2ca3296e64c2e` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.897597 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 588/1171] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 31 15:12:03 2022] PUT /identity/v3/projects/d413ea97608e4bf3afbc8a45e209c7a7/users/94bd427e4e21457e8f643095172868c7/roles/807b71faee4a435e95e2ca3296e64c2e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 15:12:03.902677 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c14fa-889c-4baf-b58f-688355515fae None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:03.902965 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c14fa-889c-4baf-b58f-688355515fae None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:03.903245 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c14fa-889c-4baf-b58f-688355515fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:03.911873 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55151b-a8ad-49b3-a11d-870dfb109d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0580c993c824eca809a43afee13c505, user_id=6056231e2f4c48e099425bb4f0454061, role_id=807b71faee4a435e95e2ca3296e64c2e)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:03.917228 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55151b-a8ad-49b3-a11d-870dfb109d4d admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:03.924388 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-b95c14fa-889c-4baf-b58f-688355515fae None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:03.925660 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-b95c14fa-889c-4baf-b58f-688355515fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:03.974617 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:12:03.986367 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 589/1172] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:12:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:12:03.996283 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c14fa-889c-4baf-b58f-688355515fae None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:04.027825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 584/1173] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 31 15:12:03 2022] PUT /identity/v3/projects/b0580c993c824eca809a43afee13c505/users/6056231e2f4c48e099425bb4f0454061/roles/807b71faee4a435e95e2ca3296e64c2e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 15:12:04.033476 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f2628-9afa-4a7b-8f67-82281a073d70 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:04.033764 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f2628-9afa-4a7b-8f67-82281a073d70 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:04.034042 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f2628-9afa-4a7b-8f67-82281a073d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:04.053203 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c14fa-889c-4baf-b58f-688355515fae None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:04.054602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-4b1f2628-9afa-4a7b-8f67-82281a073d70 None None] MFA Rules not processed for user `e7a12e84a7cb44eba823234391e6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:04.054602 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-4b1f2628-9afa-4a7b-8f67-82281a073d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:04.104234 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:12:04.104662 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb69c61-e1a4-4806-8a4b-b129299d959a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:04.105243 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb69c61-e1a4-4806-8a4b-b129299d959a service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:04.105520 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb69c61-e1a4-4806-8a4b-b129299d959a service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:04.105791 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb69c61-e1a4-4806-8a4b-b129299d959a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:04.116220 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 585/1174] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:12:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:12:04.127275 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f2628-9afa-4a7b-8f67-82281a073d70 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:04.137655 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f2628-9afa-4a7b-8f67-82281a073d70 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:04.142478 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b923450-db41-4501-8de1-3f21abfaca37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:04.143278 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b923450-db41-4501-8de1-3f21abfaca37 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:04.144052 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b923450-db41-4501-8de1-3f21abfaca37 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:04.144514 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b923450-db41-4501-8de1-3f21abfaca37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:04.153964 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b923450-db41-4501-8de1-3f21abfaca37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:04.157332 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b923450-db41-4501-8de1-3f21abfaca37 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:04.165716 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 586/1175] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:12:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:12:04.173143 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb69c61-e1a4-4806-8a4b-b129299d959a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:04.174678 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb69c61-e1a4-4806-8a4b-b129299d959a service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:04.184301 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 590/1176] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:12:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 15:12:10.978022 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9890dcd-b801-45b8-a480-0cc95e9d845f None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:10.978022 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9890dcd-b801-45b8-a480-0cc95e9d845f None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:10.978022 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9890dcd-b801-45b8-a480-0cc95e9d845f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.011232 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-f9890dcd-b801-45b8-a480-0cc95e9d845f None None] MFA Rules not processed for user `94bd427e4e21457e8f643095172868c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:11.012807 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-f9890dcd-b801-45b8-a480-0cc95e9d845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:11.024207 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28de6c2-969b-4c5c-b129-8fde1a251121 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.024708 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28de6c2-969b-4c5c-b129-8fde1a251121 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.024792 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28de6c2-969b-4c5c-b129-8fde1a251121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.086645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-f28de6c2-969b-4c5c-b129-8fde1a251121 None None] MFA Rules not processed for user `6056231e2f4c48e099425bb4f0454061`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:11.086645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-f28de6c2-969b-4c5c-b129-8fde1a251121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:11.114986 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 587/1177] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:12:10 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:12:11.122825 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9890dcd-b801-45b8-a480-0cc95e9d845f None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:11.139465 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9890dcd-b801-45b8-a480-0cc95e9d845f None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:11.145530 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671da4bc-8254-483f-949a-6c6252e3f31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:11.146605 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671da4bc-8254-483f-949a-6c6252e3f31b admin admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.147120 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671da4bc-8254-483f-949a-6c6252e3f31b admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.148206 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671da4bc-8254-483f-949a-6c6252e3f31b admin admin] PATH_INFO: `/v3/projects` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.149072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671da4bc-8254-483f-949a-6c6252e3f31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:11.151398 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671da4bc-8254-483f-949a-6c6252e3f31b admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:11.181139 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:12:11.210668 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 591/1178] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:12:11 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:12:11.215334 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28de6c2-969b-4c5c-b129-8fde1a251121 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:11.229047 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28de6c2-969b-4c5c-b129-8fde1a251121 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:11.237449 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae43c2-ba82-4b1a-b1a3-56aa4c08b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:11.241630 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae43c2-ba82-4b1a-b1a3-56aa4c08b99a admin admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.241630 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae43c2-ba82-4b1a-b1a3-56aa4c08b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.241630 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae43c2-ba82-4b1a-b1a3-56aa4c08b99a admin admin] PATH_INFO: `/v3/projects` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.241630 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae43c2-ba82-4b1a-b1a3-56aa4c08b99a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:11.242150 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae43c2-ba82-4b1a-b1a3-56aa4c08b99a admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:11.259182 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 588/1179] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 31 15:12:11 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 15:12:11.261396 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671da4bc-8254-483f-949a-6c6252e3f31b admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:11.353414 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671da4bc-8254-483f-949a-6c6252e3f31b admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:11.358905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597547bb-828e-414a-8726-326b907caf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:11.359905 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597547bb-828e-414a-8726-326b907caf9e admin admin] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.360024 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597547bb-828e-414a-8726-326b907caf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.360294 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597547bb-828e-414a-8726-326b907caf9e admin admin] PATH_INFO: `/v3/users` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.360939 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597547bb-828e-414a-8726-326b907caf9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:11.363085 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597547bb-828e-414a-8726-326b907caf9e admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:11.389150 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 592/1180] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 31 15:12:11 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 15:12:11.389150 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae43c2-ba82-4b1a-b1a3-56aa4c08b99a admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:11.478543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 589/1181] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 31 15:12:11 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 15:12:11.485272 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae43c2-ba82-4b1a-b1a3-56aa4c08b99a admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:11.486279 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597547bb-828e-414a-8726-326b907caf9e admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:11.493124 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9ebe8-38db-4e62-bdc8-2cda58f34b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:11.493822 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9ebe8-38db-4e62-bdc8-2cda58f34b9f admin admin] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.494170 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9ebe8-38db-4e62-bdc8-2cda58f34b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.494558 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9ebe8-38db-4e62-bdc8-2cda58f34b9f admin admin] PATH_INFO: `/v3/users` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.495271 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9ebe8-38db-4e62-bdc8-2cda58f34b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:11.497509 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9ebe8-38db-4e62-bdc8-2cda58f34b9f admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:11.521497 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597547bb-828e-414a-8726-326b907caf9e admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:11.528006 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008562-e3fb-4466-8e39-8e288a7fa98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:11.533120 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008562-e3fb-4466-8e39-8e288a7fa98c admin admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.534161 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008562-e3fb-4466-8e39-8e288a7fa98c admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.534161 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008562-e3fb-4466-8e39-8e288a7fa98c admin admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.534717 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13008562-e3fb-4466-8e39-8e288a7fa98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:11.536466 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13008562-e3fb-4466-8e39-8e288a7fa98c admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:11.565051 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 590/1182] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 31 15:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 15:12:11.571258 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008562-e3fb-4466-8e39-8e288a7fa98c admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:11.588506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008562-e3fb-4466-8e39-8e288a7fa98c admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:11.594243 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f146b-8e64-4d3d-9e3a-81eff9c49698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:11.596348 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f146b-8e64-4d3d-9e3a-81eff9c49698 admin admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.596797 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f146b-8e64-4d3d-9e3a-81eff9c49698 admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.597438 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f146b-8e64-4d3d-9e3a-81eff9c49698 admin admin] PATH_INFO: `/v3/projects/4ec19a8c8ac8407db32fa2e72267ae50/users/dbaf15d3704f444bb450fda976be05fd/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.620800 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 593/1183] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 31 15:12:11 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 15:12:11.627252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f146b-8e64-4d3d-9e3a-81eff9c49698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec19a8c8ac8407db32fa2e72267ae50, user_id=dbaf15d3704f444bb450fda976be05fd, role_id=7fe1d0d9f098408c9dc7ed9fca08a4a4)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:11.627447 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9ebe8-38db-4e62-bdc8-2cda58f34b9f admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:11.628033 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f146b-8e64-4d3d-9e3a-81eff9c49698 admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:11.641785 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9ebe8-38db-4e62-bdc8-2cda58f34b9f admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:11.649885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d5aa8-2805-4ce7-a054-4dcfcdbc8245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:11.649885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d5aa8-2805-4ce7-a054-4dcfcdbc8245 admin admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.649885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d5aa8-2805-4ce7-a054-4dcfcdbc8245 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.649885 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d5aa8-2805-4ce7-a054-4dcfcdbc8245 admin admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.650419 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d5aa8-2805-4ce7-a054-4dcfcdbc8245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:11.650499 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d5aa8-2805-4ce7-a054-4dcfcdbc8245 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:11.661988 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 594/1184] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 31 15:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 15:12:11.666058 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d5aa8-2805-4ce7-a054-4dcfcdbc8245 admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:11.678350 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d5aa8-2805-4ce7-a054-4dcfcdbc8245 admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:11.684131 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38e281-ddc9-422f-b0be-a3de21ef7a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:11.685474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38e281-ddc9-422f-b0be-a3de21ef7a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.686222 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38e281-ddc9-422f-b0be-a3de21ef7a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.687655 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38e281-ddc9-422f-b0be-a3de21ef7a5d admin admin] PATH_INFO: `/v3/projects/1305d3ecf2114d1dabd39d55775cd1a3/users/409f69372a8c4641bab211730ef2a3e9/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.708334 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38e281-ddc9-422f-b0be-a3de21ef7a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1305d3ecf2114d1dabd39d55775cd1a3, user_id=409f69372a8c4641bab211730ef2a3e9, role_id=7fe1d0d9f098408c9dc7ed9fca08a4a4)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:11.712598 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38e281-ddc9-422f-b0be-a3de21ef7a5d admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:11.727907 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 591/1185] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 31 15:12:11 2022] PUT /identity/v3/projects/4ec19a8c8ac8407db32fa2e72267ae50/users/dbaf15d3704f444bb450fda976be05fd/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:12:11.731822 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f146b-8e64-4d3d-9e3a-81eff9c49698 admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:11.741175 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:12:11.787911 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 595/1186] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 31 15:12:11 2022] PUT /identity/v3/projects/1305d3ecf2114d1dabd39d55775cd1a3/users/409f69372a8c4641bab211730ef2a3e9/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 15:12:11.792157 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38e281-ddc9-422f-b0be-a3de21ef7a5d admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:11.826680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f146b-8e64-4d3d-9e3a-81eff9c49698 admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:11.900146 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38e281-ddc9-422f-b0be-a3de21ef7a5d admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:11.902265 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa1996-21cf-463d-878b-1bfdb80b6de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:11.902909 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa1996-21cf-463d-878b-1bfdb80b6de9 admin admin] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.903189 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa1996-21cf-463d-878b-1bfdb80b6de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.903456 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa1996-21cf-463d-878b-1bfdb80b6de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.904212 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa1996-21cf-463d-878b-1bfdb80b6de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:11.905312 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9d654-5493-465f-bd8c-93432fa72b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:11.906044 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa1996-21cf-463d-878b-1bfdb80b6de9 admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:11.906371 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9d654-5493-465f-bd8c-93432fa72b46 admin admin] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.907307 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9d654-5493-465f-bd8c-93432fa72b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.907710 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9d654-5493-465f-bd8c-93432fa72b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.909310 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9d654-5493-465f-bd8c-93432fa72b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:11.911014 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9d654-5493-465f-bd8c-93432fa72b46 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:11.918132 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 592/1187] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 31 15:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 15:12:11.922135 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa1996-21cf-463d-878b-1bfdb80b6de9 admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:11.926102 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 596/1188] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 31 15:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 15:12:11.927047 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9d654-5493-465f-bd8c-93432fa72b46 admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:11.938105 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9d654-5493-465f-bd8c-93432fa72b46 admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:11.939311 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa1996-21cf-463d-878b-1bfdb80b6de9 admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:11.943552 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a68787-4e97-4b38-a7d8-1de5c0f1e925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:11.944482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55537f43-f701-4b7b-8368-1fb898ede3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:11.945187 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55537f43-f701-4b7b-8368-1fb898ede3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.945468 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55537f43-f701-4b7b-8368-1fb898ede3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.945730 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a68787-4e97-4b38-a7d8-1de5c0f1e925 admin admin] REQUEST_METHOD: `PUT` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:11.945894 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55537f43-f701-4b7b-8368-1fb898ede3c3 admin admin] PATH_INFO: `/v3/projects/4ec19a8c8ac8407db32fa2e72267ae50/users/dbaf15d3704f444bb450fda976be05fd/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.946050 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a68787-4e97-4b38-a7d8-1de5c0f1e925 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:11.946336 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a68787-4e97-4b38-a7d8-1de5c0f1e925 admin admin] PATH_INFO: `/v3/projects/1305d3ecf2114d1dabd39d55775cd1a3/users/409f69372a8c4641bab211730ef2a3e9/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:11.948347 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a68787-4e97-4b38-a7d8-1de5c0f1e925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1305d3ecf2114d1dabd39d55775cd1a3, user_id=409f69372a8c4641bab211730ef2a3e9, role_id=7fe1d0d9f098408c9dc7ed9fca08a4a4)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:11.953063 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a68787-4e97-4b38-a7d8-1de5c0f1e925 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:11.953221 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55537f43-f701-4b7b-8368-1fb898ede3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec19a8c8ac8407db32fa2e72267ae50, user_id=dbaf15d3704f444bb450fda976be05fd, role_id=7fe1d0d9f098408c9dc7ed9fca08a4a4)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:11.955270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55537f43-f701-4b7b-8368-1fb898ede3c3 admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:11.967992 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 593/1190] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 31 15:12:11 2022] PUT /identity/v3/projects/4ec19a8c8ac8407db32fa2e72267ae50/users/dbaf15d3704f444bb450fda976be05fd/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 15:12:11.970408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 597/1190] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 31 15:12:11 2022] PUT /identity/v3/projects/1305d3ecf2114d1dabd39d55775cd1a3/users/409f69372a8c4641bab211730ef2a3e9/roles/7fe1d0d9f098408c9dc7ed9fca08a4a4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:12:19.374739 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161bee-f257-497f-b7bb-389f2fccf25b None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:19.375766 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161bee-f257-497f-b7bb-389f2fccf25b None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:19.376938 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161bee-f257-497f-b7bb-389f2fccf25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:19.455072 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-c5161bee-f257-497f-b7bb-389f2fccf25b None None] MFA Rules not processed for user `409f69372a8c4641bab211730ef2a3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:19.459442 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-c5161bee-f257-497f-b7bb-389f2fccf25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:19.641737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 594/1191] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:12:19 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:12:19.651760 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a68787-4e97-4b38-a7d8-1de5c0f1e925 admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:19.654157 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-58a68787-4e97-4b38-a7d8-1de5c0f1e925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:19.669295 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:12:19.738491 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a68787-4e97-4b38-a7d8-1de5c0f1e925 admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:19.800927 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4416-a98e-4320-a659-215cdf433cf7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0027b550fa4eaaa3f95da115d7da02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:19.801829 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4416-a98e-4320-a659-215cdf433cf7 service glance] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:19.802114 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4416-a98e-4320-a659-215cdf433cf7 service glance] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:19.802433 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4416-a98e-4320-a659-215cdf433cf7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:19.803075 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a248a-a517-4c2c-ae6f-7bc53d26b978 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:19.803535 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a248a-a517-4c2c-ae6f-7bc53d26b978 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:19.803882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a248a-a517-4c2c-ae6f-7bc53d26b978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:19.859617 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-762a248a-a517-4c2c-ae6f-7bc53d26b978 None None] MFA Rules not processed for user `dbaf15d3704f444bb450fda976be05fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:19.861028 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-762a248a-a517-4c2c-ae6f-7bc53d26b978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:19.872585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:12:19.894763 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea4416-a98e-4320-a659-215cdf433cf7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:19.895627 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea4416-a98e-4320-a659-215cdf433cf7 service glance] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:19.906262 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 598/1192] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:12:19 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:12:19.962433 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 595/1193] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:12:19 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:12:19.972036 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4416-a98e-4320-a659-215cdf433cf7 service glance] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:19.973784 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-32ea4416-a98e-4320-a659-215cdf433cf7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:19.986645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4416-a98e-4320-a659-215cdf433cf7 service glance] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:19.993406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc4080-8a0a-4f6b-ad6d-e37e49abca7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0027b550fa4eaaa3f95da115d7da02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:19.993406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc4080-8a0a-4f6b-ad6d-e37e49abca7b service glance] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:19.993406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc4080-8a0a-4f6b-ad6d-e37e49abca7b service glance] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:19.993406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc4080-8a0a-4f6b-ad6d-e37e49abca7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:20.060202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc4080-8a0a-4f6b-ad6d-e37e49abca7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:20.061676 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc4080-8a0a-4f6b-ad6d-e37e49abca7b service glance] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:20.071532 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 599/1194] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:12:19 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 15:12:29.482952 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df467a8f-d7c8-4dea-9034-276181529cb6 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:29.484787 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df467a8f-d7c8-4dea-9034-276181529cb6 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:29.484787 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df467a8f-d7c8-4dea-9034-276181529cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:29.505645 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-df467a8f-d7c8-4dea-9034-276181529cb6 None None] MFA Rules not processed for user `94bd427e4e21457e8f643095172868c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:29.507437 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-df467a8f-d7c8-4dea-9034-276181529cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:29.515100 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 596/1195] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:12:29 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:12:29.825122 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81365de5-62d1-414d-a22e-2dc7afabb21e None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:29.825682 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81365de5-62d1-414d-a22e-2dc7afabb21e None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:29.825899 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81365de5-62d1-414d-a22e-2dc7afabb21e None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:29.828986 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 600/1196] 10.222.0.52 () {54 vars in 962 bytes} [Wed Aug 31 15:12:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:12:29.834443 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f93d73-4093-465c-a0a4-5fc817e64cc4 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:29.834728 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f93d73-4093-465c-a0a4-5fc817e64cc4 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:29.835251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f93d73-4093-465c-a0a4-5fc817e64cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:29.860009 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-48f93d73-4093-465c-a0a4-5fc817e64cc4 None None] MFA Rules not processed for user `98bb7c83115a45f1bdf9f48c6599db18`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:29.861227 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-48f93d73-4093-465c-a0a4-5fc817e64cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:29.948313 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 597/1197] 10.222.0.52 () {58 vars in 1059 bytes} [Wed Aug 31 15:12:29 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:12:29.955739 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65095704-8216-43a4-85b1-ef5ff5090fb9 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:29.956027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65095704-8216-43a4-85b1-ef5ff5090fb9 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:29.956383 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65095704-8216-43a4-85b1-ef5ff5090fb9 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:29.958089 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 601/1198] 10.222.0.52 () {54 vars in 912 bytes} [Wed Aug 31 15:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 15:12:29.963968 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc96198-ec88-4a81-9f3f-3ed6ab41dc72 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:29.964276 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc96198-ec88-4a81-9f3f-3ed6ab41dc72 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:29.964573 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc96198-ec88-4a81-9f3f-3ed6ab41dc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:29.988016 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-5dc96198-ec88-4a81-9f3f-3ed6ab41dc72 None None] MFA Rules not processed for user `98bb7c83115a45f1bdf9f48c6599db18`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:29.989390 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-5dc96198-ec88-4a81-9f3f-3ed6ab41dc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:29.998597 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 598/1199] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 31 15:12:29 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:12:30.015062 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65095704-8216-43a4-85b1-ef5ff5090fb9 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:30.030324 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65095704-8216-43a4-85b1-ef5ff5090fb9 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:30.035194 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8ffc8-1082-4a45-9844-4665191764d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0027b550fa4eaaa3f95da115d7da02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:30.035805 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ffc8-1082-4a45-9844-4665191764d0 service glance] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:30.036117 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ffc8-1082-4a45-9844-4665191764d0 service glance] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:30.036392 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ffc8-1082-4a45-9844-4665191764d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:30.047823 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8ffc8-1082-4a45-9844-4665191764d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:30.049286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8ffc8-1082-4a45-9844-4665191764d0 service glance] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:30.060883 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 602/1200] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:12:30 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:12:30.453910 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc7fb0-f9c9-4d49-999e-f27a0f9c495b None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:30.454185 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc7fb0-f9c9-4d49-999e-f27a0f9c495b None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:30.454488 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc7fb0-f9c9-4d49-999e-f27a0f9c495b None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:30.455870 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 599/1201] 10.222.0.52 () {54 vars in 912 bytes} [Wed Aug 31 15:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:12:30.464630 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87878aaa-c959-4681-a9ac-f9a9557d5974 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:30.465000 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87878aaa-c959-4681-a9ac-f9a9557d5974 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:30.465286 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87878aaa-c959-4681-a9ac-f9a9557d5974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:30.477248 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=100 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:12:30.490832 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-87878aaa-c959-4681-a9ac-f9a9557d5974 None None] MFA Rules not processed for user `5c3e43e391e1470e90b21511b98b0d40`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:30.492137 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-87878aaa-c959-4681-a9ac-f9a9557d5974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:30.565119 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 603/1202] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 31 15:12:30 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:12:30.578898 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc7fb0-f9c9-4d49-999e-f27a0f9c495b None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:30.581168 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-3cbc7fb0-f9c9-4d49-999e-f27a0f9c495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:30.596978 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc7fb0-f9c9-4d49-999e-f27a0f9c495b None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:30.604597 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db3c47-521e-46c8-a0ca-c890dd3db6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:30.605498 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db3c47-521e-46c8-a0ca-c890dd3db6fa service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:30.605776 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db3c47-521e-46c8-a0ca-c890dd3db6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:30.606475 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db3c47-521e-46c8-a0ca-c890dd3db6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:30.616151 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db3c47-521e-46c8-a0ca-c890dd3db6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:30.617817 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db3c47-521e-46c8-a0ca-c890dd3db6fa service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:30.642993 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 600/1203] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:12:30 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:12:31.132020 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366629fd-da6f-45d6-9b1f-92c418999113 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:31.132830 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366629fd-da6f-45d6-9b1f-92c418999113 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:31.132830 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366629fd-da6f-45d6-9b1f-92c418999113 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:31.133919 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 604/1204] 10.222.0.52 () {54 vars in 962 bytes} [Wed Aug 31 15:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:12:31.140719 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961a36e-7975-46b8-aa7a-9156bacf2ffb None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:31.141475 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961a36e-7975-46b8-aa7a-9156bacf2ffb None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:31.141475 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961a36e-7975-46b8-aa7a-9156bacf2ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:31.161775 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366629fd-da6f-45d6-9b1f-92c418999113 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:31.164628 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-9961a36e-7975-46b8-aa7a-9156bacf2ffb None None] MFA Rules not processed for user `98bb7c83115a45f1bdf9f48c6599db18`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:31.166242 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-9961a36e-7975-46b8-aa7a-9156bacf2ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:31.176526 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 601/1205] 10.222.0.52 () {58 vars in 1059 bytes} [Wed Aug 31 15:12:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:12:31.182420 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233ccf7-b6c2-4233-ad8c-1df7a90d5573 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:31.182706 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233ccf7-b6c2-4233-ad8c-1df7a90d5573 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:31.182982 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233ccf7-b6c2-4233-ad8c-1df7a90d5573 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:31.184315 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 602/1206] 10.222.0.52 () {54 vars in 912 bytes} [Wed Aug 31 15:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 15:12:31.190282 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33be62-3245-4838-a4a9-2f84fe54ed22 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:31.190583 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33be62-3245-4838-a4a9-2f84fe54ed22 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:31.190868 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33be62-3245-4838-a4a9-2f84fe54ed22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:31.221707 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-ed33be62-3245-4838-a4a9-2f84fe54ed22 None None] MFA Rules not processed for user `98bb7c83115a45f1bdf9f48c6599db18`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:31.223676 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-ed33be62-3245-4838-a4a9-2f84fe54ed22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:31.234193 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 603/1207] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 31 15:12:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:12:31.246540 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366629fd-da6f-45d6-9b1f-92c418999113 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:31.246707 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33be62-3245-4838-a4a9-2f84fe54ed22 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:31.252675 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03270b23-97e2-474f-a8af-e2cc5c8942e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63cdd2ef65aa46fab70d0d09b7d7d17c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:31.253200 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03270b23-97e2-474f-a8af-e2cc5c8942e8 service placement] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:31.253507 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03270b23-97e2-474f-a8af-e2cc5c8942e8 service placement] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:31.253786 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03270b23-97e2-474f-a8af-e2cc5c8942e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:31.256315 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-03270b23-97e2-474f-a8af-e2cc5c8942e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:31.258428 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33be62-3245-4838-a4a9-2f84fe54ed22 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:31.264174 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657502c-29ee-4633-b129-f7e229be3b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:31.264174 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657502c-29ee-4633-b129-f7e229be3b0a service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:31.264174 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657502c-29ee-4633-b129-f7e229be3b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:31.264174 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657502c-29ee-4633-b129-f7e229be3b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:31.269402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03270b23-97e2-474f-a8af-e2cc5c8942e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:31.271202 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03270b23-97e2-474f-a8af-e2cc5c8942e8 service placement] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:31.274984 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657502c-29ee-4633-b129-f7e229be3b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:31.276294 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657502c-29ee-4633-b129-f7e229be3b0a service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:31.293169 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 605/1208] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:12:31 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 15:12:31.293288 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 604/1209] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:12:31 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 15:12:41.280852 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=54 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:12:41.289667 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=78 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:12:43.658474 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683522f-63ef-4334-af9a-b1104618b446 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:43.659121 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683522f-63ef-4334-af9a-b1104618b446 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:43.659121 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683522f-63ef-4334-af9a-b1104618b446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:43.682450 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-5683522f-63ef-4334-af9a-b1104618b446 None None] MFA Rules not processed for user `5c3e43e391e1470e90b21511b98b0d40`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:43.684579 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-5683522f-63ef-4334-af9a-b1104618b446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:43.693499 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 606/1210] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Aug 31 15:12:43 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:12:43.705643 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657502c-29ee-4633-b129-f7e229be3b0a service neutron] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:43.715247 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657502c-29ee-4633-b129-f7e229be3b0a service neutron] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:43.719436 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8545e4-4730-40d9-87bd-2a6d8ad9a6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:43.720033 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8545e4-4730-40d9-87bd-2a6d8ad9a6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:43.720302 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8545e4-4730-40d9-87bd-2a6d8ad9a6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:43.720569 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8545e4-4730-40d9-87bd-2a6d8ad9a6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:43.728033 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8545e4-4730-40d9-87bd-2a6d8ad9a6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:43.729502 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8545e4-4730-40d9-87bd-2a6d8ad9a6d4 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:43.738688 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 605/1211] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:12:43 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:12:45.065254 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d53a-bb5e-4c8d-86da-f6c73afd5902 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:45.065852 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d53a-bb5e-4c8d-86da-f6c73afd5902 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:45.065852 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d53a-bb5e-4c8d-86da-f6c73afd5902 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:45.067103 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 607/1212] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 31 15:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:12:45.091516 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c7da1-1155-437c-af3f-16339614e132 None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:45.092542 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c7da1-1155-437c-af3f-16339614e132 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:45.092542 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c7da1-1155-437c-af3f-16339614e132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:45.122224 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-c22c7da1-1155-437c-af3f-16339614e132 None None] MFA Rules not processed for user `98bb7c83115a45f1bdf9f48c6599db18`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:45.125720 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-c22c7da1-1155-437c-af3f-16339614e132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:45.137150 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 606/1213] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 31 15:12:45 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:12:45.174684 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121d53a-bb5e-4c8d-86da-f6c73afd5902 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:45.190536 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121d53a-bb5e-4c8d-86da-f6c73afd5902 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:45.197659 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed29c3-1e43-43e8-86e4-0588f7a697b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:45.198268 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed29c3-1e43-43e8-86e4-0588f7a697b3 service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:45.198579 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed29c3-1e43-43e8-86e4-0588f7a697b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:45.198847 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed29c3-1e43-43e8-86e4-0588f7a697b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:45.208010 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed29c3-1e43-43e8-86e4-0588f7a697b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:45.210149 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed29c3-1e43-43e8-86e4-0588f7a697b3 service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:45.221976 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 608/1214] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:12:45 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:12:51.576034 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d997-062c-4f4c-81f4-09906e907b8a None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:51.577363 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d997-062c-4f4c-81f4-09906e907b8a None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:51.577759 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d997-062c-4f4c-81f4-09906e907b8a None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:51.579289 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 607/1215] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 31 15:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:12:51.590084 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb52c-45f7-490f-bd4c-9598cdd49e83 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:51.590668 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb52c-45f7-490f-bd4c-9598cdd49e83 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:51.590668 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb52c-45f7-490f-bd4c-9598cdd49e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:51.611149 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-b30bb52c-45f7-490f-bd4c-9598cdd49e83 None None] MFA Rules not processed for user `98bb7c83115a45f1bdf9f48c6599db18`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:12:51.612386 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-b30bb52c-45f7-490f-bd4c-9598cdd49e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:12:51.621144 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 609/1216] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 31 15:12:51 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:12:51.633570 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d997-062c-4f4c-81f4-09906e907b8a None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:12:51.649394 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d997-062c-4f4c-81f4-09906e907b8a None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:12:51.667645 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55370f-c423-4e09-b375-08999526ca82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:12:51.668665 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55370f-c423-4e09-b375-08999526ca82 service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:12:51.669011 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55370f-c423-4e09-b375-08999526ca82 service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:12:51.669338 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55370f-c423-4e09-b375-08999526ca82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:12:51.681176 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55370f-c423-4e09-b375-08999526ca82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:12:51.684503 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55370f-c423-4e09-b375-08999526ca82 service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:12:51.702680 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 608/1217] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:12:51 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:13:01.605525 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=12 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:13:01.693795 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=15 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:13:10.472953 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bb52c-45f7-490f-bd4c-9598cdd49e83 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:13:10.482149 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bb52c-45f7-490f-bd4c-9598cdd49e83 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:13:10.486163 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb3f2e-eff3-4641-bc88-c4309a0e1931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:13:10.486818 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb3f2e-eff3-4641-bc88-c4309a0e1931 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:13:10.487164 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb3f2e-eff3-4641-bc88-c4309a0e1931 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:13:10.487531 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb3f2e-eff3-4641-bc88-c4309a0e1931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:13:10.496875 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb3f2e-eff3-4641-bc88-c4309a0e1931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:13:10.498585 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb3f2e-eff3-4641-bc88-c4309a0e1931 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:13:10.508359 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 610/1218] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:13:10 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:13:12.824826 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee486a6-e873-469f-976e-d01a8adaf5b3 None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:13:12.825426 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee486a6-e873-469f-976e-d01a8adaf5b3 None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:13:12.825426 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee486a6-e873-469f-976e-d01a8adaf5b3 None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:13:12.827429 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 609/1219] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 31 15:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:13:12.833318 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2f187-bc55-42d5-9a9e-264b52435d15 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:13:12.833898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2f187-bc55-42d5-9a9e-264b52435d15 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:13:12.833898 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2f187-bc55-42d5-9a9e-264b52435d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:13:12.869940 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-d1b2f187-bc55-42d5-9a9e-264b52435d15 None None] MFA Rules not processed for user `98bb7c83115a45f1bdf9f48c6599db18`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:13:12.872949 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-d1b2f187-bc55-42d5-9a9e-264b52435d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:13:12.882601 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 611/1220] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 31 15:13:12 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:13:12.902686 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee486a6-e873-469f-976e-d01a8adaf5b3 None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:13:12.921604 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee486a6-e873-469f-976e-d01a8adaf5b3 None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:13:12.931727 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abfc543-30c5-4064-873a-fae9b2b08e2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:13:12.932803 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfc543-30c5-4064-873a-fae9b2b08e2d service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:13:12.933316 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfc543-30c5-4064-873a-fae9b2b08e2d service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:13:12.934222 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfc543-30c5-4064-873a-fae9b2b08e2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:13:12.948747 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abfc543-30c5-4064-873a-fae9b2b08e2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:13:12.954737 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abfc543-30c5-4064-873a-fae9b2b08e2d service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:13:12.967318 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 610/1221] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:13:12 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:13:22.863656 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=9 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:13:22.962197 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=6 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:14:19.981030 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46b53-7676-46a2-b867-a4233a30e41c None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:14:19.981542 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46b53-7676-46a2-b867-a4233a30e41c None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:14:19.981630 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46b53-7676-46a2-b867-a4233a30e41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:14:20.010136 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-c6d46b53-7676-46a2-b867-a4233a30e41c None None] MFA Rules not processed for user `6056231e2f4c48e099425bb4f0454061`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:14:20.011366 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-c6d46b53-7676-46a2-b867-a4233a30e41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:14:20.035768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 612/1222] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:14:19 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:14:30.033045 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=15 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:14:58.895160 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c9de-9ccb-483b-a3b8-aedfed9c422a None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:14:58.895691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c9de-9ccb-483b-a3b8-aedfed9c422a None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:14:58.895691 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c9de-9ccb-483b-a3b8-aedfed9c422a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:14:58.916065 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-4f15c9de-9ccb-483b-a3b8-aedfed9c422a None None] MFA Rules not processed for user `6056231e2f4c48e099425bb4f0454061`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:14:58.917284 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-4f15c9de-9ccb-483b-a3b8-aedfed9c422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:14:58.925223 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 611/1223] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:14:58 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:14:59.226940 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236f5f-a11d-41f5-bcb8-b315595f0763 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:14:59.227391 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236f5f-a11d-41f5-bcb8-b315595f0763 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:14:59.227569 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236f5f-a11d-41f5-bcb8-b315595f0763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:14:59.296640 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-6c236f5f-a11d-41f5-bcb8-b315595f0763 None None] MFA Rules not processed for user `5c3e43e391e1470e90b21511b98b0d40`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:14:59.297804 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-6c236f5f-a11d-41f5-bcb8-b315595f0763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:14:59.329764 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 613/1224] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 31 15:14:59 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:14:59.341627 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15c9de-9ccb-483b-a3b8-aedfed9c422a None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:14:59.351066 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15c9de-9ccb-483b-a3b8-aedfed9c422a None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:14:59.355254 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300bf7-9e9e-453c-bd21-3d8027d02d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:14:59.355836 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300bf7-9e9e-453c-bd21-3d8027d02d90 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:14:59.356110 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300bf7-9e9e-453c-bd21-3d8027d02d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:14:59.356378 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300bf7-9e9e-453c-bd21-3d8027d02d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:14:59.363374 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91300bf7-9e9e-453c-bd21-3d8027d02d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:14:59.364842 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91300bf7-9e9e-453c-bd21-3d8027d02d90 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:14:59.373248 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 612/1225] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:14:59 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:15:09.326952 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=33 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:15:09.369742 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=9 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:15:16.786407 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63572a3-cecc-463a-b7e6-3aff6c033cb7 None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:15:16.786872 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63572a3-cecc-463a-b7e6-3aff6c033cb7 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:15:16.786956 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63572a3-cecc-463a-b7e6-3aff6c033cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:15:16.805792 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-f63572a3-cecc-463a-b7e6-3aff6c033cb7 None None] MFA Rules not processed for user `6056231e2f4c48e099425bb4f0454061`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:15:16.807010 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-f63572a3-cecc-463a-b7e6-3aff6c033cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:15:16.813857 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 614/1226] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:15:16 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:15:26.800645 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=3 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:15:39.015559 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300bf7-9e9e-453c-bd21-3d8027d02d90 service neutron] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:15:39.048112 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300bf7-9e9e-453c-bd21-3d8027d02d90 service neutron] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:15:39.053621 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca227-d1fa-43d0-9e05-bae3666e4b3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63cdd2ef65aa46fab70d0d09b7d7d17c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:15:39.054268 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca227-d1fa-43d0-9e05-bae3666e4b3c service placement] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:15:39.054585 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca227-d1fa-43d0-9e05-bae3666e4b3c service placement] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:15:39.054861 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca227-d1fa-43d0-9e05-bae3666e4b3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:15:39.063668 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ca227-d1fa-43d0-9e05-bae3666e4b3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:15:39.065289 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ca227-d1fa-43d0-9e05-bae3666e4b3c service placement] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:15:39.075015 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 613/1227] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:15:39 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:15:49.071065 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=13 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:16:38.567448 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa9f04-0606-4002-b518-bed462656c4b None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:16:38.567990 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa9f04-0606-4002-b518-bed462656c4b None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:16:38.568079 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa9f04-0606-4002-b518-bed462656c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:16:38.587281 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-50fa9f04-0606-4002-b518-bed462656c4b None None] MFA Rules not processed for user `6056231e2f4c48e099425bb4f0454061`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:16:38.588473 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-50fa9f04-0606-4002-b518-bed462656c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:16:38.595527 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 615/1228] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:16:38 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:16:48.581590 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=3 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:16:54.031875 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca227-d1fa-43d0-9e05-bae3666e4b3c service placement] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:16:54.042178 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca227-d1fa-43d0-9e05-bae3666e4b3c service placement] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:16:54.045955 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da42de5-17bd-4870-b5cc-94cf4c593875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:16:54.046597 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da42de5-17bd-4870-b5cc-94cf4c593875 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:16:54.046878 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da42de5-17bd-4870-b5cc-94cf4c593875 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:16:54.047154 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da42de5-17bd-4870-b5cc-94cf4c593875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:16:54.057659 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da42de5-17bd-4870-b5cc-94cf4c593875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:16:54.059123 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da42de5-17bd-4870-b5cc-94cf4c593875 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:16:54.069060 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 614/1229] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:16:54 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:17:04.064372 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=6 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:17:05.544351 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59574a-4694-4fca-aa32-8f5363542ace None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:17:05.544750 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59574a-4694-4fca-aa32-8f5363542ace None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:17:05.544891 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59574a-4694-4fca-aa32-8f5363542ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:17:05.564354 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-8a59574a-4694-4fca-aa32-8f5363542ace None None] MFA Rules not processed for user `94bd427e4e21457e8f643095172868c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:17:05.565562 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-8a59574a-4694-4fca-aa32-8f5363542ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:17:05.573270 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 616/1230] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 31 15:17:05 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:17:15.578812 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=3 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:17:20.147597 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da42de5-17bd-4870-b5cc-94cf4c593875 service neutron] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:17:20.169234 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da42de5-17bd-4870-b5cc-94cf4c593875 service neutron] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:17:20.174197 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1fd16-81df-4408-afc7-c142f007479b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:17:20.174829 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1fd16-81df-4408-afc7-c142f007479b service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:17:20.175105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1fd16-81df-4408-afc7-c142f007479b service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:17:20.175371 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1fd16-81df-4408-afc7-c142f007479b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:17:20.184230 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1fd16-81df-4408-afc7-c142f007479b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:17:20.185794 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1fd16-81df-4408-afc7-c142f007479b service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:17:20.195251 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 615/1231] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:17:20 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:17:30.190763 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=10 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:17:32.905650 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59574a-4694-4fca-aa32-8f5363542ace None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:17:32.916516 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59574a-4694-4fca-aa32-8f5363542ace None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:17:32.920214 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85b6a2-8448-4484-b663-e8a1bdfa9965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:17:32.920836 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85b6a2-8448-4484-b663-e8a1bdfa9965 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:17:32.921105 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85b6a2-8448-4484-b663-e8a1bdfa9965 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:17:32.921372 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85b6a2-8448-4484-b663-e8a1bdfa9965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:17:32.932024 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85b6a2-8448-4484-b663-e8a1bdfa9965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:17:32.933402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85b6a2-8448-4484-b663-e8a1bdfa9965 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:17:32.944787 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 617/1232] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:17:32 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:17:38.715852 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1fd16-81df-4408-afc7-c142f007479b service nova] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:17:38.727878 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1fd16-81df-4408-afc7-c142f007479b service nova] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:17:38.731722 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ebc83-8a2c-4512-9a47-0f3e88fc8db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:17:38.732329 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ebc83-8a2c-4512-9a47-0f3e88fc8db8 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:17:38.732611 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ebc83-8a2c-4512-9a47-0f3e88fc8db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:17:38.733092 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ebc83-8a2c-4512-9a47-0f3e88fc8db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:17:38.750972 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ebc83-8a2c-4512-9a47-0f3e88fc8db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:17:38.752441 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ebc83-8a2c-4512-9a47-0f3e88fc8db8 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:17:38.764806 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 616/1233] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:17:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:17:42.939219 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=6 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:17:48.759767 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=6 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:18:02.201996 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85b6a2-8448-4484-b663-e8a1bdfa9965 service neutron] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:18:02.210981 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85b6a2-8448-4484-b663-e8a1bdfa9965 service neutron] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:18:02.215153 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c70ea-13a8-4836-823e-f320466bf832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:18:02.215777 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c70ea-13a8-4836-823e-f320466bf832 service neutron] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:18:02.216059 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c70ea-13a8-4836-823e-f320466bf832 service neutron] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:18:02.216333 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c70ea-13a8-4836-823e-f320466bf832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:18:02.223519 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c70ea-13a8-4836-823e-f320466bf832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:18:02.224936 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c70ea-13a8-4836-823e-f320466bf832 service neutron] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:18:02.233657 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 618/1234] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:18:02 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:18:12.229402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=6 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:18:52.667753 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ebc83-8a2c-4512-9a47-0f3e88fc8db8 service neutron] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:18:52.680590 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ebc83-8a2c-4512-9a47-0f3e88fc8db8 service neutron] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:18:52.686337 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20fb10-93ad-4682-93b8-6ae1289f791d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:18:52.687168 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20fb10-93ad-4682-93b8-6ae1289f791d service nova] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:18:52.688025 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20fb10-93ad-4682-93b8-6ae1289f791d service nova] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:18:52.688529 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20fb10-93ad-4682-93b8-6ae1289f791d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:18:52.698494 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20fb10-93ad-4682-93b8-6ae1289f791d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:18:52.700733 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20fb10-93ad-4682-93b8-6ae1289f791d service nova] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:18:52.713147 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 617/1235] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:18:52 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:18:54.165704 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c70ea-13a8-4836-823e-f320466bf832 service neutron] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:18:54.180563 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c70ea-13a8-4836-823e-f320466bf832 service neutron] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:18:54.186228 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03428079-f366-4834-88f3-7462807e9ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:18:54.191794 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03428079-f366-4834-88f3-7462807e9ca0 service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:18:54.191794 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03428079-f366-4834-88f3-7462807e9ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:18:54.191794 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03428079-f366-4834-88f3-7462807e9ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:18:54.198402 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03428079-f366-4834-88f3-7462807e9ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:18:54.200344 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03428079-f366-4834-88f3-7462807e9ca0 service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:18:54.214146 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 619/1236] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:18:54 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:19:02.707969 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=6 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:19:04.207535 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=6 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:19:09.291615 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20fb10-93ad-4682-93b8-6ae1289f791d service nova] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:19:09.302270 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20fb10-93ad-4682-93b8-6ae1289f791d service nova] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:19:09.305922 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115e3ba-1170-4539-8170-76c32cd488b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:19:09.306553 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115e3ba-1170-4539-8170-76c32cd488b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:19:09.306832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115e3ba-1170-4539-8170-76c32cd488b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:19:09.307103 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115e3ba-1170-4539-8170-76c32cd488b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:19:09.382536 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115e3ba-1170-4539-8170-76c32cd488b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:19:09.383941 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115e3ba-1170-4539-8170-76c32cd488b9 service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:19:09.403331 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 618/1237] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:19:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:19:13.403052 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b6b94-4576-4096-9a39-b836045008b6 None None] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:19:13.404660 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b6b94-4576-4096-9a39-b836045008b6 None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:19:13.404660 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b6b94-4576-4096-9a39-b836045008b6 None None] PATH_INFO: `/` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:19:13.405054 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 620/1238] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 31 15:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 15:19:13.416606 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429da16-5c2a-4a30-9e59-8a51151dccad None None] REQUEST_METHOD: `POST` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:19:13.417120 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429da16-5c2a-4a30-9e59-8a51151dccad None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:19:13.417312 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429da16-5c2a-4a30-9e59-8a51151dccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:19:13.459482 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.auth.core [None req-1429da16-5c2a-4a30-9e59-8a51151dccad None None] MFA Rules not processed for user `63cdd2ef65aa46fab70d0d09b7d7d17c`. Rule list: `[]` (Enabled: `True`). {{(pid=88468) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:19:13.460774 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-1429da16-5c2a-4a30-9e59-8a51151dccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:19:13.469477 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 619/1239] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 31 15:19:13 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 15:19:13.480535 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b6b94-4576-4096-9a39-b836045008b6 None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:19:13.493623 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b6b94-4576-4096-9a39-b836045008b6 None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:19:13.498507 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6112b8f-d13a-4a05-9574-250d5253f09e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63cdd2ef65aa46fab70d0d09b7d7d17c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:19:13.499092 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6112b8f-d13a-4a05-9574-250d5253f09e service placement] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:19:13.499364 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6112b8f-d13a-4a05-9574-250d5253f09e service placement] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:19:13.500305 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6112b8f-d13a-4a05-9574-250d5253f09e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:19:13.508945 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6112b8f-d13a-4a05-9574-250d5253f09e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:19:13.510587 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6112b8f-d13a-4a05-9574-250d5253f09e service placement] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:19:13.521085 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 621/1240] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:19:13 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:19:17.332159 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d05c6a-ae83-4698-997e-46553da6473e None None] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:19:17.332701 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d05c6a-ae83-4698-997e-46553da6473e None None] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:19:17.332701 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d05c6a-ae83-4698-997e-46553da6473e None None] PATH_INFO: `/` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:19:17.334061 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 620/1241] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 31 15:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 15:19:17.344288 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1fe3f-b55b-47a0-966c-3fbd6fa9bdbd None None] REQUEST_METHOD: `POST` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:19:17.344767 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1fe3f-b55b-47a0-966c-3fbd6fa9bdbd None None] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:19:17.345186 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1fe3f-b55b-47a0-966c-3fbd6fa9bdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:19:17.365753 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.auth.core [None req-ddc1fe3f-b55b-47a0-966c-3fbd6fa9bdbd None None] MFA Rules not processed for user `63cdd2ef65aa46fab70d0d09b7d7d17c`. Rule list: `[]` (Enabled: `True`). {{(pid=88467) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 15:19:17.367050 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-ddc1fe3f-b55b-47a0-966c-3fbd6fa9bdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:19:17.377145 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 622/1242] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 31 15:19:17 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 15:19:17.391729 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d05c6a-ae83-4698-997e-46553da6473e None None] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:19:17.406757 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d05c6a-ae83-4698-997e-46553da6473e None None] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:19:17.412294 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cca68c-bd98-41b2-b9fc-8bd1122df2e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63cdd2ef65aa46fab70d0d09b7d7d17c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:19:17.412886 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cca68c-bd98-41b2-b9fc-8bd1122df2e6 service placement] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:19:17.413161 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cca68c-bd98-41b2-b9fc-8bd1122df2e6 service placement] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:19:17.413427 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cca68c-bd98-41b2-b9fc-8bd1122df2e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:19:17.421890 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cca68c-bd98-41b2-b9fc-8bd1122df2e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:19:17.423721 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cca68c-bd98-41b2-b9fc-8bd1122df2e6 service placement] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:19:17.433503 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 621/1243] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:19:17 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:19:17.545734 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1fe3f-b55b-47a0-966c-3fbd6fa9bdbd None None] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:19:17.557398 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1fe3f-b55b-47a0-966c-3fbd6fa9bdbd None None] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:19:17.562944 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:19:17.563638 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:19:17.564566 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:19:17.564921 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] PATH_INFO: `/v3/users/94bd427e4e21457e8f643095172868c7` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:19:17.566276 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94bd427e4e21457e8f643095172868c7)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:19:17.567306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: WARNING py.warnings [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:19:17.567306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: warnings.warn(msg) Aug 31 15:19:17.567306 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: Aug 31 15:19:17.568553 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:19:17.821335 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94bd427e4e21457e8f643095172868c7'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:17.821907 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94bd427e4e21457e8f643095172868c7'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:17.832810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94bd427e4e21457e8f643095172868c7'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:17.938808 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94bd427e4e21457e8f643095172868c7'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:17.939444 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94bd427e4e21457e8f643095172868c7'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:17.964782 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 623/1244] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 31 15:19:17 2022] DELETE /identity/v3/users/94bd427e4e21457e8f643095172868c7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:19:18.258122 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cca68c-bd98-41b2-b9fc-8bd1122df2e6 service placement] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:19:18.270223 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cca68c-bd98-41b2-b9fc-8bd1122df2e6 service placement] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:19:18.334058 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:19:18.334827 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:19:18.335105 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:19:18.335377 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] PATH_INFO: `/v3/projects/d413ea97608e4bf3afbc8a45e209c7a7` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:19:18.336485 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d413ea97608e4bf3afbc8a45e209c7a7)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:19:18.337495 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: WARNING py.warnings [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 15:19:18.337495 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: warnings.warn(msg) Aug 31 15:19:18.337495 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: Aug 31 15:19:18.343288 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:19:18.452854 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:19:18.456961 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd413ea97608e4bf3afbc8a45e209c7a7', 'request_id': 'req-505e9129-e268-44df-827d-0512911a51f1'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:18.470028 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd413ea97608e4bf3afbc8a45e209c7a7', 'request_id': 'req-505e9129-e268-44df-827d-0512911a51f1'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:18.567196 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd413ea97608e4bf3afbc8a45e209c7a7', 'request_id': 'req-505e9129-e268-44df-827d-0512911a51f1'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:18.591848 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] The token cache is being invalidate because project d413ea97608e4bf3afbc8a45e209c7a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 15:19:18.592145 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:18.592808 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:18.594409 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 622/1245] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 31 15:19:18 2022] DELETE /identity/v3/projects/d413ea97608e4bf3afbc8a45e209c7a7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:19:18.599032 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:19:18.600501 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:19:18.613336 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bd5a3-606e-4307-8385-92618a9c8793 admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:19:18.668861 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:19:18.669485 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:19:18.669768 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:19:18.670026 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] PATH_INFO: `/v3/users/dbaf15d3704f444bb450fda976be05fd` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:19:18.671174 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbaf15d3704f444bb450fda976be05fd)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:19:18.673127 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:19:18.885154 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbaf15d3704f444bb450fda976be05fd'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:18.885808 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbaf15d3704f444bb450fda976be05fd'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:18.891316 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:19:18.893859 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbaf15d3704f444bb450fda976be05fd'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:19.012733 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbaf15d3704f444bb450fda976be05fd'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:19.013408 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbaf15d3704f444bb450fda976be05fd'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:19.031726 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 624/1246] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 31 15:19:18 2022] DELETE /identity/v3/users/dbaf15d3704f444bb450fda976be05fd => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:19:19.346087 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:19:19.347629 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:19:19.362321 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e9129-e268-44df-827d-0512911a51f1 admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:19:19.422326 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:19:19.422972 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:19:19.423863 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:19:19.424133 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] PATH_INFO: `/v3/projects/4ec19a8c8ac8407db32fa2e72267ae50` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:19:19.425252 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec19a8c8ac8407db32fa2e72267ae50)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:19:19.427235 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:19:19.553423 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec19a8c8ac8407db32fa2e72267ae50', 'request_id': 'req-e0dc1e43-92bd-4265-8342-945b9cbf1314'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:19.559733 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec19a8c8ac8407db32fa2e72267ae50', 'request_id': 'req-e0dc1e43-92bd-4265-8342-945b9cbf1314'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:19.655899 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec19a8c8ac8407db32fa2e72267ae50', 'request_id': 'req-e0dc1e43-92bd-4265-8342-945b9cbf1314'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:19.667698 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] The token cache is being invalidate because project 4ec19a8c8ac8407db32fa2e72267ae50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 15:19:19.669832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:19.669832 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:19:19.670177 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 623/1247] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 31 15:19:19 2022] DELETE /identity/v3/projects/4ec19a8c8ac8407db32fa2e72267ae50 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:19:29.135949 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=9,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:19:29.664664 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:DELETE=11,keystone:SELECT=63,keystone:INSERT=2 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:20:17.387546 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:20:17.389053 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:20:17.473319 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920465ac-a8b6-470a-8184-cfc2400e9e38 admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:20:17.531632 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214ef4e-c72c-4447-8519-36c532dd38d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bb7c83115a45f1bdf9f48c6599db18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:20:17.532406 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214ef4e-c72c-4447-8519-36c532dd38d4 service nova] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:20:17.532680 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214ef4e-c72c-4447-8519-36c532dd38d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:20:17.532947 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214ef4e-c72c-4447-8519-36c532dd38d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:20:17.534703 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-9214ef4e-c72c-4447-8519-36c532dd38d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:20:17.596425 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214ef4e-c72c-4447-8519-36c532dd38d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:20:17.598019 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214ef4e-c72c-4447-8519-36c532dd38d4 service nova] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:20:17.607028 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 625/1248] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:20:17 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:20:27.602938 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=85 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:20:33.968755 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:20:33.970514 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:20:34.027136 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc1e43-92bd-4265-8342-945b9cbf1314 admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:20:34.030882 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e34bb-439d-46d3-b64d-0e58c13862be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3e43e391e1470e90b21511b98b0d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:20:34.031589 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e34bb-439d-46d3-b64d-0e58c13862be service neutron] REQUEST_METHOD: `GET` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:20:34.031870 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e34bb-439d-46d3-b64d-0e58c13862be service neutron] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:20:34.032141 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e34bb-439d-46d3-b64d-0e58c13862be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:20:34.033881 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-da1e34bb-439d-46d3-b64d-0e58c13862be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:20:34.095860 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e34bb-439d-46d3-b64d-0e58c13862be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:20:34.097260 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e34bb-439d-46d3-b64d-0e58c13862be service neutron] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:20:34.106566 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 624/1249] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:20:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:20:41.363789 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214ef4e-c72c-4447-8519-36c532dd38d4 service nova] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:20:41.365290 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-9214ef4e-c72c-4447-8519-36c532dd38d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:20:41.379267 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214ef4e-c72c-4447-8519-36c532dd38d4 service nova] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:20:41.383762 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:20:41.384383 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:20:41.384660 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:20:41.384926 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] PATH_INFO: `/v3/users/6056231e2f4c48e099425bb4f0454061` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:20:41.386020 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6056231e2f4c48e099425bb4f0454061)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:20:41.387934 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:20:41.601126 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6056231e2f4c48e099425bb4f0454061'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:41.601714 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6056231e2f4c48e099425bb4f0454061'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:41.608492 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6056231e2f4c48e099425bb4f0454061'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:41.688727 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6056231e2f4c48e099425bb4f0454061'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:41.689368 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6056231e2f4c48e099425bb4f0454061'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:41.707288 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 626/1250] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 31 15:20:41 2022] DELETE /identity/v3/users/6056231e2f4c48e099425bb4f0454061 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:20:41.953231 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e34bb-439d-46d3-b64d-0e58c13862be service neutron] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:20:41.964992 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e34bb-439d-46d3-b64d-0e58c13862be service neutron] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:20:42.023640 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:20:42.024266 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:20:42.024543 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:20:42.024812 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] PATH_INFO: `/v3/projects/b0580c993c824eca809a43afee13c505` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:20:42.025913 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0580c993c824eca809a43afee13c505)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:20:42.027833 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:20:42.149169 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0580c993c824eca809a43afee13c505', 'request_id': 'req-4ff88a60-6494-4502-828a-283506692d44'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:42.151056 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:20:42.155314 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0580c993c824eca809a43afee13c505', 'request_id': 'req-4ff88a60-6494-4502-828a-283506692d44'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:42.263306 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0580c993c824eca809a43afee13c505', 'request_id': 'req-4ff88a60-6494-4502-828a-283506692d44'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:42.274461 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] The token cache is being invalidate because project b0580c993c824eca809a43afee13c505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 15:20:42.274782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:42.275404 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:42.276895 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 625/1251] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 31 15:20:41 2022] DELETE /identity/v3/projects/b0580c993c824eca809a43afee13c505 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:20:42.282021 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:20:42.283456 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:20:42.296113 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c008193-9be0-40ea-ab9e-788e30ddbc81 admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:20:42.352460 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:20:42.353132 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:20:42.353413 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:20:42.353689 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] PATH_INFO: `/v3/users/409f69372a8c4641bab211730ef2a3e9` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:20:42.354832 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] RBAC: Authorizing `identity:delete_user(user_id=409f69372a8c4641bab211730ef2a3e9)` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:20:42.356747 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:20:42.540100 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409f69372a8c4641bab211730ef2a3e9'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:42.540707 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409f69372a8c4641bab211730ef2a3e9'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:42.547827 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409f69372a8c4641bab211730ef2a3e9'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:42.640584 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409f69372a8c4641bab211730ef2a3e9'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:42.641432 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.notifications [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409f69372a8c4641bab211730ef2a3e9'} {{(pid=88467) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:42.649810 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:20:42.660282 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 627/1252] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 31 15:20:42 2022] DELETE /identity/v3/users/409f69372a8c4641bab211730ef2a3e9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:20:42.928030 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] Authenticating user token {{(pid=88468) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:20:42.929511 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.fernet_utils [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88468) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:20:42.943216 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff88a60-6494-4502-828a-283506692d44 admin admin] Validating token access rules against request {{(pid=88468) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:20:43.003134 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767d100-999f-4d6b-8855-97e2f3bfaeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a12e84a7cb44eba823234391e6a002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b905fa215ef84f989a1edb29db9488aa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88468) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:20:43.003782 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767d100-999f-4d6b-8855-97e2f3bfaeea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:20:43.004035 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767d100-999f-4d6b-8855-97e2f3bfaeea admin admin] SCRIPT_NAME: `/identity` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:20:43.004312 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767d100-999f-4d6b-8855-97e2f3bfaeea admin admin] PATH_INFO: `/v3/projects/1305d3ecf2114d1dabd39d55775cd1a3` {{(pid=88468) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:20:43.005426 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767d100-999f-4d6b-8855-97e2f3bfaeea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1305d3ecf2114d1dabd39d55775cd1a3)` {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:20:43.007386 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767d100-999f-4d6b-8855-97e2f3bfaeea admin admin] RBAC: Authorization granted {{(pid=88468) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:20:43.138215 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-5767d100-999f-4d6b-8855-97e2f3bfaeea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1305d3ecf2114d1dabd39d55775cd1a3', 'request_id': 'req-5767d100-999f-4d6b-8855-97e2f3bfaeea'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:43.144878 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-5767d100-999f-4d6b-8855-97e2f3bfaeea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1305d3ecf2114d1dabd39d55775cd1a3', 'request_id': 'req-5767d100-999f-4d6b-8855-97e2f3bfaeea'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:43.217224 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-5767d100-999f-4d6b-8855-97e2f3bfaeea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1305d3ecf2114d1dabd39d55775cd1a3', 'request_id': 'req-5767d100-999f-4d6b-8855-97e2f3bfaeea'} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:43.228222 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-5767d100-999f-4d6b-8855-97e2f3bfaeea admin admin] The token cache is being invalidate because project 1305d3ecf2114d1dabd39d55775cd1a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88468) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 15:20:43.228506 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-5767d100-999f-4d6b-8855-97e2f3bfaeea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:43.229138 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG keystone.notifications [None req-5767d100-999f-4d6b-8855-97e2f3bfaeea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88468) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 15:20:43.230706 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: [pid: 88468|app: 0|req: 626/1253] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 31 15:20:42 2022] DELETE /identity/v3/projects/1305d3ecf2114d1dabd39d55775cd1a3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 15:20:52.815549 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:20:53.225080 dv-osbrick-853789-3-ceph devstack@keystone.service[88468]: DEBUG dbcounter [-] [88468] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:21:31.464199 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] Authenticating user token {{(pid=88467) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 15:21:31.465623 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:21:31.552631 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ee5f9-0858-46b2-9cab-1f25c4dc721d admin admin] Validating token access rules against request {{(pid=88467) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 15:21:31.613223 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373b948-8ab3-47ea-b9f0-89a4e1d423c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63cdd2ef65aa46fab70d0d09b7d7d17c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac45966110b47f28339c78e693b3793', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88467) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 15:21:31.613828 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373b948-8ab3-47ea-b9f0-89a4e1d423c6 service placement] REQUEST_METHOD: `GET` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 15:21:31.614110 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373b948-8ab3-47ea-b9f0-89a4e1d423c6 service placement] SCRIPT_NAME: `/identity` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 15:21:31.614438 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373b948-8ab3-47ea-b9f0-89a4e1d423c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88467) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 15:21:31.616239 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.fernet_utils [None req-0373b948-8ab3-47ea-b9f0-89a4e1d423c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88467) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 15:21:31.627787 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373b948-8ab3-47ea-b9f0-89a4e1d423c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 15:21:31.629361 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373b948-8ab3-47ea-b9f0-89a4e1d423c6 service placement] RBAC: Authorization granted {{(pid=88467) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 15:21:31.639079 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: [pid: 88467|app: 0|req: 628/1254] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 31 15:21:31 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 15:21:41.635027 dv-osbrick-853789-3-ceph devstack@keystone.service[88467]: DEBUG dbcounter [-] [88467] Writing DB stats keystone:SELECT=63 {{(pid=88467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}